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Chapter 1 
Introduction 



1.1 Motivation 

Statistical physics is an unfinished and highly active part of physics. We do not have the the- 
oretical framework in which to even attempt to describe highly irreversible processes such as 
fracture. Many types of nonlinear systems that lead to complicated pattern formation processes, 
the properties of granular media, earthquakes, friction and many other systems are beyond our 
present understanding and theoretical tools. 

In the study of these and other macroscopic systems we build on the established conceptual 
framework of thermodynamics and statistical physics. Thermodynamics, put into its formal and 
phenomenological form by Clausius, is a theory of impressive range of validity. Thermody- 
namics describes all systems form classical gases and liquids, through quantum systems such as 
superconductors and nuclear matter, to black holes and elementary particles in the early universe 
in exactly the same form as they were originally formulated.^ 

Statistical physics, on the other hand gives a rational understanding of Thermodynamics in 
terms of microscopic particles and their interactions. Statistical physics allows not only the cal- 
culation of the temperature dependence of thermodynamics quantities, such as the specific heats 
of solids for instance, but also of transport properties, the conduction of heat and electricity for 
example. Moreover, statistical physics in its modern form has given us a complete understand- 
ing of second-order phase transitions, and with Wilson's Renormalization Group theory we may 
calculate the scaling exponents observed in experiments on phase transitions. 

However, the field of statistical physics is in a phase of rapid change. New ideas and concepts 
permit a fresh approach to old problems. With new concepts we look for features ignored in 
previous experiments and find exciting results. Key words are deterministic chaos, fractals, self- 
organized criticality (SOC), turbulence and intermitency. These words represent large fields of 
study which have changed how we view Nature. 

Disordered systems, percolation theory and fractals find applications not only in physics and 
engineering but also in economics and other social sciences. 

What are the processes that describe the evolution of complex systems! Again we have an 

'From the introduction of Ravndal's lecture notes on Statistical Physics 
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active field with stochastic processes as a key word. 

So what has been going on? Why have the mysteries and excitement of statistical physics not 
been introduced to you before? 

The point is that statistical physics is unfinished, subtle, intellectually and mathematically 
demanding. The activity in statistical physics has philosophical implications that have not been 
discussed by professional philosophers — and have had little influence on the thinking of the 
general public. 

Deterministic behavior rules the day. Privately, on the public arena, in industry, man- 
agement and in teaching we almost invariably assume that any given action leads predictably 
to the desired result — and we are surprised and discouraged when it does notP The next level 
is that some feed-back is considered — but again things get too simplistic. Engineers who study 
road traffic reach the conclusion that more roads will make congestions worse, not better — a 
statement that cannot be generally true. Similarly, the "Club of Rome" report predicted that we 
would run out of resources very quickly. The human population would grow to an extent that 
would outstrip food, metals, oil and other resources. However, this did not happen. Now, with 
a much large population we have more food, metals, and oil per capita than we had when the 
report was written. Of course, statistical physics cannot be applied to all areas. The point is that 
in physics, statistical physics provides us with many examples of complex systems and complex 
dynamics that we may understand in detail. 

Statistical physics provides an intellectual framework and a systematic approach to the study 
of real world systems with complicated interactions and feedback mechanisms. I expect that the 
new concepts in statistical physics will eventually have a significant impact not only on other 
sciences, but also on the public sector to an extent that we may speak of as a paradigm shift. 

1.2 Deterministic Chaos 

Deterministic chaos appears to be an oxymoron, i. e. a contradiction of terms. It is not. The 
concept of deterministic chaos has changed the thinking of anyone who gets some insight into 
what it means. Deterministic chaos may arise in any non- linear system with few (active) degrees 
of freedom, e. g. electric oscillator circuits, driven pendulums, thermal convection, lasers, and 
many other systems. The central theme is that the time evolution of the system is sensitive 
so initial conditions. Consider a system that evolves in time as described by the deterministic 
equations of motion, a pendulum driven with a small force oscillating at a frequency (0, for 
example. Starting from given initial condition the pendulum will evolve in time as determined 
by the equation of motion. If we start again with new initial condition, arbitrarily close to the 
previous case, the pendulum will again evolve deterministically, but its state as a function of 
time will have a distance (in some measure) that diverges exponentially from the first realization. 
Since the initial condition cannot be specified with arbitrary precision, the orbit in fact becomes 
unpredictable — even in principle. 

It is this incredible sensitivity to initial conditions for deterministic systems that has deep 



2 Discuss the telephone system at the University of Oslo 



1.3. ATOMISTIC PHILOSOPHY 



3 



philosophical implications. The conclusion, at least how I see it, is that determinism and ran- 
domness are just two aspects of same system. 

The planetary system is known to be chaotic! That is, we cannot, even in principle, predict 
lunar eclipse, the relative positions of planets, the rotation of the earth as a function of time. 
What is going on? The point is that non-linear systems that exhibit deterministic chaos have 
a time horizon beyond which we cannot predict the time evolution because of the exponential 
sensitivity on initial conditions. For the weather we have a time horizon of two weeks in typical 
situations. There exist initial conditions that have time horizons further in the future, for the 
planetary system the time horizon is millions of years, but chaotic behavior has nevertheless been 
observed for the motion of Io, one of Jupiter's moons. Chaos is also required for an understanding 
of the banding of the rings of JupiterP Very accurate numerical solutions of Newton's equations 
for the solar system also exhibit deterministic chaos. 

1.3 Atomistic Philosophy 

Now, for systems with many active degrees of freedom, we observe cooperative phenomena, i. e. 
behavior that does not depend on the details of the system. We observe universality, or universal 
behavior, that cannot be explained by an atomistic understanding alone. 

Let me explain: The atomistic philosophy is strong and alive. We believe that with an atom- 
istic understanding of the particles that constitute matter — and their interactions — it is merely 
an exercise in applied mathematics to predict the macroscopic behavior of systems of practical 
importance. This certainly is an arrogant physicists attitude. It must be said, however, that the 
experiments and theories are entirely consistent with this view — in spite of deterministic chaos, 
self-organized criticality and their ilk. 

It is clear that the quantum mechanics required to describe the interactions of atoms in chem- 
ical systems is fully understood. We have the exact solution for the Hydrogen atom, the approx- 
imate solution for the Helium atom, and numerical solutions for more complex atoms and their 
interactions in molecules. There is no evidence that there are open questions in the foundation of 
quantum chemistry. Thus we know what is required for a rational understanding of chemistry — 
the work has been done, we only need to apply what is known practical tasks in engineering and 
industry so to say. 

Since we understand chemistry, no new fundamental laws of Nature are required to under- 
stand biochemistry, and finally by implication the brain — how we think and understand! 

What folly! Clearly something is wrong with this line of reasoning. Molecular biology is 
at present the field of science that has the highest rate of discovery, while physicist have been 
waiting for almost thirty years for the observation of the Higgs Boson predicted by the standard 
model. Elementary particle theory clearly lies at the foundation of physics — but the rate of 
discovery has slowed to a glacial pace. 

What is going on? I believe the point is that the evolution of science in the 20th century 
has lead to a focus on the atomistic part of the atomistic philosophy. Quantum mechanics was a 

3 The ring were first observed by Galileo in 1616 with a telescope he had built. By 1655 Huygens had resolved 
the banding, not fully explained yet. 
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fantastic break-through, which completely dominated physics in the first half of previous century. 
Discoveries, were made at an astounding rate. Suddenly we understood spectra, the black-body 
radiation, X-rays, radioactivity, all kinds of new particles, electrons, protons, neutrons, anti- 
particles and much more. Much was finished before the second World war, whereas nuclear 
reactors, and weapons, were largely developed in 50's and 60's. The search for elementary 
particles, the constituents of nuclear matter, and their interactions gained momentum in the 50's 
and truly fantastic research organizations of unprecedented size, such as CERN, dedicated to 
basic research were set up. 

This enthusiasm was appropriate and lead to a long string of discoveries (and Nobel prizes) 
that have changed our society in fundamental ways. 

Quantum mechanics is, of course, also at the basis of the electronics industry, computers, 
communication, lasers and other engineering products that have changed our lives. 

However, this huge effort on the atomistic side, left small resources — both human and otherwise — 
to other parts of physics. The intellectual resources were largely concentrated on particle physics 
research, the other aspects of the atomistic philosophy, namely the understanding of the natu- 
ral world in terms of the (newly gained) atomistic physics, was left to an uncoordinated little 
publicized and conceptually demanding effort. 

1.3.1 Cooperative Phenomena 

Cooperative phenomena are ubiquitous and well known from daily life. Take hydrodynamics 
for example. Air, water, wine, molten steel, liquid argon — all share the same hydrodynamics. 
They flow, fill vessels, they from drops and bubbles, have surface waves, vortices and exhibit 
many other hydrodynamic phenomena — in spite of the fact that molten steel, water and argon 
are definitely described by quite different Hamilton operators that encode their quantum me- 
chanics. How can it be that important macroscopic properties do not depend on the details of the 
Hamiltonian? 

Phase transitions are also universal: Magnetism and the liquid-vapor transition belong to the 
same universality class; in an abstract sense they are the same phase transition! Ferro-electricity, 
spinodal decomposition, superconductivity, are all phenomena that do not depend on the details 
of their atomistic components and their interactions — they are cooperative phenomena. 

The understanding of cooperative phenomena is far from complete. We have no general 
theory, except for second order phase transitions, and the phenomenological equations for hy- 
drodynamics, to classify and simplify the general scaling and other fractal phenomena observed 
in highly non-equilibrium systems. Here we have a very active branch of statistical physics. 

1.4 Outlook 

So what is the underlying conceptual framework on which physics attempts to fill the gap in un- 
derstanding the macroscopic world? How do we connect the microscopic with the macroscopic? — 
of course, by the scientific approach, by observation, experiment, theory, and now computational 
modeling. 
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First of all: For macroscopic systems, we have a fantastic phenomenological theory: ther- 
modynamics valid at or near thermal equilibrium, and for systems that start in an equilibrium 
state and wind up in an equilibrium state (explosions for example). Thermodynamics was devel- 
oped largely in the 19th century, with significant developments in our century related to quantum 
mechanics and phase transitions. Thermodynamics in the present form was really formulated as 
an axiomatic system with the three laws of thermodynamics. The central concept is energy^, and 
of course entropy, the only concept required in all the three laws of thermodynamics. 

Secondly: Statistical physics started with Daniel Bernoulli (1700-1792), was given a new 
start by Rudolf Clausius (1822-1888), James Clerk Maxwell (1831-1879) contributed the kinetic 
theory of gases and his famous velocity distribution. Ludwig Boltzmann (1844-1906) made 
the fundamental connection to kinetics and introduced the famous expression S = klnW the 
statistical expression for the entropy, and explained why entropy must increase by his //-theorem. 
Josiah Willard Gibbs (1839-1903), made fundamental contributions to the modern formulation 
of statistical mechanics. In this century Lars Onsager (1903-1976) made several outstanding 
contributions. By his exact solution of the Ising model, in two-spatial dimensions, he proved that 
the framework of statistical physics could indeed tackle the problem of phase transitions. He 
received the 1968 Nobel prize in chemistry for his work on irreversible thermodynamics. Claude 
E. Shannon initiated information theory by his 1948 paper analyzing measures of information 
transmitted through a communication channel. His measure of information is directly related to 
Boltzmann's statistical measure of entropy. The last break-trough contribution was by Kenneth 
Geddes Wilson (1936-), who was awarded the 1982 Nobel prize in physics for Renormalization 
group theory that allows the calculation of scaling exponents at second order phase transitions. 

1.5 What will we do? 

This is what now think we should do in this course. We cannot get into all the interesting things 
at the frontier of research. On the contrary the purpose of this course is to acquaint you with 
the central issues of statistical mechanics. I will be guided by Finn Ravndals notes, and my own 
tastes, and hope I do not overload the course. It is better to understand the a number of central 
issues thoroughly, they provide anchor points for further investigation if your studies, or later 
work require them. 



4 Energy, an old word first used by Thomas Young in 1807 to signify mv 2 , not [\mv 2 ] from Greek en in +ergon 
work (or rather: at work) 
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Chapter 2 

Historical Background 



The sensation of hot and cold; that is temperature, and the use of fire in cooking (heat) pre- 
dates written history. The scientific understanding of temperature and heat is surprisingly recent. 
Emilio Segre has written a wonderful account of the evolution of our understanding of heat, 
temperature and other aspects of the foundation of modern physics. 

The concepts of temperature, heat, work and entropy grew gradually from the time of Galileo 
and culminated with the formulation of classical thermodynamics by Rudolf Clausius (1822- 
1888). At this stage there were two principles of thermodynamics formulated by Clausius: 

I The energy of the universe is constant 

II The entropy of the universe tends to a maximum 

Clausius introduce the word entropy in 1865,from the Greek Tponf\ (Verwandlung; transforma- 
tion). Entropy, a fundamental concept in thermodynamics, is involved in both principles. Now 
entropy is most readily understood in terms of statistical physics. In classical physics there is no 
reference point for entropy. Walther Hermann Nernst (1864-1941) formulated the third principle 
of thermodynamics: 

III The entropy vanishes for a system at zero absolute temperature, 

a conclusion Nernst reached by experimental investigations of vapors at high temperature, solids 
at low temperature and galvanic cells. He received the 1920 Nobel Prize for Chemistry for his 
discovery 

Classical mechanics is reversible. For particles that interact with forces that may be derived 
from a potential the classical paths are strictly time-reversible, and the total energy of the system 
is conserved. This situation is not changed by quantum mechanics. The deep problem is therefore 
to understand how entropy can always increase as equilibrium is approached. 

Interestingly the principle of energy conservation, i. e. the so called first law of thermody- 
namics I, was established after Carnot's discovery of the second law of thermodynamics. 

Entropy is a concept of great practical importance, but it is a concept that is difficult to 
understand. The following quote from a nice little book: Steam Engine Principles^ Calvert 
(1991) illustrates the difficulty: 



7 



8 



CHAPTER 2. HISTORICAL BACKGROUND 



A forth property is entropyPrhis has no physical existence and it has an arbitrary 
datum, but its changes can be precisely calculated. Such changes are listed in tables 
and plotted on charts. It is unprofitable to find an analogue for entropy. There is 
none. It must be accepted and used. It is as much a handicap to try to understand 
what is going on in our steam engine without recourse to entropy tables or charts as 
it is for a coastwise navigator to reject the tide tables. In both cases the tables are 
prepared by the learned and they are intended to be used without question by the 
practical man. 

Of course, there are objections to Clausius' formulation of the first law: The energy universe 
is not conserved unless we take into account the equivalence of mass and energy as stated in 
Einstein's famous formula E = mc 2 . However, in classical systems that are 'closed' energy is 
indeed conserved. 

There are equivalent formulations of these two 'laws' of thermodynamics that give more 
insight. 

2.1 Temperature 

Galileo (1564-1642) around 1592 built a fluid based thermoscope which could be used to show 
changes in temperature. However the thermoscope had no fixed point and temperatures form 
different thermoscopes could not be compared. Disciples of Galileo and others in the Academia 
del Cimento (in Florence) made systematic studies using a thermometer. Isaac Newton (1642- 
1727) proposed a temperature scale in which the freezing point of water was set to zero, and the 
temperature of the human body to twelve. 

Daniel Gabriel Fahrenheit (1686-1736) was born in Danzig but studied in Holland and 
worked in Amsterdam. Fahrenheit proposed a temperature scale still used today. He used al- 
cohol thermometers and was the first to make a mercury thermometer. Fahrenheit used three 
fixed points: (1): degrees for a mixture of ice, water and salt; (2): 32 degrees for a mixture 
of ice and water; (3): 96 degrees at the body temperature of a 'healthy' person in the mouth or 
under the arm. This temperature scale has the advantage that most temperatures experienced in 
daily life are all positive. 

Fahrenheit was the first to observe and describe super-cooling of water in small capillaries. 
He used rain-water in a 1 inch bulb that he evacuated in the manner used by him to make ther- 
mometers. Fahrenheit found that the water was liquid at 15 degrees, i. e. -9.4 °C, and solidified 
immediately if he broke the tip of the capillary attached to the bulb to admit air. 

We now mostly use the Celsius temperature scale. Anders Celsius (1701-1744) was a pro- 
fessor of astronomy at the university of Uppsala. In 1742 he described his thermometer to the 
Swedish Academy of Sciences. The thermometer had the melting point of snow as one fixed 
point at 100 °C and the boiling point of water was set to °C. This was later inverted so that 
0° is the melting point of snow, and 100° as the other, for the centigrade scale. The name was 
changed in 1948 to honor Celsius. 



the others are: pressure, temperature, and density 
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William Thomson (later Lord Kelvin) introduce the absolute temperature scale. (More later) 

2.2 Steam Engines 

The steam engine was developed and played an important role in the industrial revolution, start- 
ing in England in the mid- 18th century. The name we normally associate with the steam engine 
is James Watt (1736-1819) who introduced the condenser, patented in 1768: "A New Invented 
Method of Lessening the Consumption of Steam and Fuel in Fire Engines.'^ Watts invention 
greatly increased the efficiency^ of the steam engine patented in 1705 by Thomas Newcomen 
(1663-1729) used to drive pumps in coal mines (see Fig. 12. II ) The steam engine was further de- 




Figure 2.1: The Newcomen steam engine worked 
in a simple fashion. Steam generated in the boiler is 
admitted to the cylinder by opening the valve (a) and 
the weight of the other end of the arm pull the pis- 
ton upward. The cylinder volume is filled and heated 
by the steam at atmospheric pressure. By closing the 
valve (a) and opening the valve (b) cold water is in- 
troduced into the cylinder. The steam condenses and 
cools thereby reducing the pressure in the cylinder 
so that the piston moves down pushed by the atmo- 
spheric pressure. The excess water runs out of the 
tube (f). When the cylinder has cooled down the cy- 
cle can start again. The maximum pressure difference 
that can be obtained is then given by the length of the 
tube (f) and the temperature of the surroundings. 



veloped in the coming years by many engineers without a deeper understanding of the efficiency 
of the engine. Watt's invention alone significantly reduced the amount of coal needed to perform 
a given amount of work, and thus made steam engines practical. There were dangers, of course. 
For instance, in 1877 there were in Germany 20 explosions of steam boilers injuring 58 persons. 
In 1890 there were 14 such explosions (of a vastly larger number of boilers) injuring 18 persons. 
Stationary steam engines were used in industry, for railroads, in agriculture and later for electric 
power generation. The table shows that there was a dramatic increase in the use of steam engines 
only 120 years ago — now they are almost extinct. Steam turbines have replaced steam engines 
completely for electric power generation. 

2 'Watt, James' Britannica Online, <http://www.eb.com: 180/cgi-bin/g?DocF=micro/632/91.html> 
3 from 1% to 2% 
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Figure 2.2: The steam was generated at atmospheric 
pressure and introduced into the cylinder just as in 
the Newcomen engine. However, in contrast with 
the Newcomen engine the steam was condensed in 
the small cylinder (K) immersed in cold water. The 
machine shown was double-acting, i. e. it worked 
both on the down- and the up-stroke. various arrange- 
ments opened and closed valves automatically. The 
water in the condenser was pumped out. The central 
improvement was that there was no need to cool the 
cylinder between strokes. 





1879 


1879 


Type of Steam engine 


Number 


Horse power 


Number 


Horse power 


Free standing 

Mobile 

Ship 


29 895 
5 442 
623 


887 780 
47 104 
50 309 


45 192 
11 916 
1 674 


1 508 195 
1 1 1 070 
154 189 



Table 2.1: Steam engines in Prussia. Globally there were about 1.9 million steam engines in the 
world around 1890. 

2.3 Sadi Carnot 

Thermodynamics as a field of science started with Sadi Carnot (1796-1831). He published in 
1824 remarkable bookReflexions sur la Puissance Motrice du Feu, et sur les Machines Propres 
a developper cette Puissance — his only published scientific work. But hardly anyone bought the 
book, and it became very difficult to obtain only a few years later. It was Emile Clapeyron (1799- 
1864), who understood Carnot's work and expressed the results in a more mathematical form in 
the paperpublished in 1834. Fourteen years later Clayperon's work was expanded by William 
ThomsorP (1824-1907). Thomson studied Carnot's paper in 1847 and realized that the Carnot 
cycle could be used to define an absolute temperature scale. However, with Carnot, he as late as 
in 1848 thought that heat was conserved, which is incorrect. This view was, however, changed 
by James Prescott Joule (1818-1889), and together they established the correct interpretation and 
thereby the principle of conservation of energy. 



4 Thomson was knighted in 1866, raised to the peerage in 1892 as Baron Kelvin of Largs. 
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The beginning of Sadi Carnot's book gives a feel for the technological optimism at the be- 
ginning of the 19th century, and the motivation of his work: 

EVERY one knows that heat can produce motion. That it possesses vast motive- 
power no one can doubt, in these days when the steam-engine is everywhere so well 
known. 

To heat also are due the vast movements which take place on the earth. It causes 
the agitations of the atmosphere, the ascension of clouds, the fall of rain and of 
meteors,^ the currents of water which channel the surface of the globe, and of which 
man has thus far employed but a small portion. Even earthquakes and volcanic 
eruptions are the result of heat. 

From this immense reservoir we may draw the moving force necessary for our 
purposes. Nature, in providing us with combustibles on all sides, has given us the 
power to produce, at all times and in all places, heat and the impelling power which 
is the result of it. To develop this power, to appropriate it to our uses, is the object of 
heat-engines. 

The study of these engines is of the greatest interest, their importance is enor- 
mous, their use is continually increasing, and they seem destined to produce a great 
revolution in the civilized world. 

Already the steam-engine works our mines, impels our ships, excavates our ports 
and our rivers, forges iron, fashions wood, grinds grains, spins and weaves our cloths, 
transports the heaviest burdens, etc. It appears that it must some day serve as a 
universal motor, and be substituted for animal power, waterfalls, and air currents. 

After a discussion of the importance of steam-engines for England, he notes: 

The discovery of the steam-engine owed its birth, like most human inventions, to 
rude attempts which have been attributed to different persons, while the real author 
is not certainly known. It is, however, less in the first attempts that the principal 
discovery consists, than in the successive improvements which have brought steam- 
engines to the conditions in which we find them today. There is almost as great 
a distance between the first apparatus in which the expansive force of steam was 
displayed and the existing machine, as between the first raft that man ever made and 
the modern vessel. 

Here Carnot expresses, in an amicable fashion, the unreasonable effectiveness of engineering. 
The path for the original invention to the final product of generations of engineers, through a 
never ending series of improvements leads to qualitatively new products. 

After this motivation of his work he approaches the more general scientific question: 

Notwithstanding the work of all kinds done by steam-engines, notwithstanding the 
satisfactory condition to which they have been brought today, their theory is very lit- 
tle understood, and the attempts to improve them are still directed almost by chance. 

5 This is a misunderstanding, the movement of meteors has nothing to do with heat. When they enter the atmo- 
sphere, friction from the air cause them to heat and glow. 
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The question has often been raised whether the motive power of heaP is un- 
bounded, whether the possible improvements in steam engines have an assignable 
limit — a limit which the nature of things will not allow to be passed by any means 
whatever; or whether, on the contrary, these improvements may be carried on indefi- 
nitely. We have long sought, and are seeking today, to ascertain whether there are in 
existence agents preferable to the vapor of water for developing the motive power of 
heat; whether atmospheric air, for example, would not present in this respect great 
advantages. We propose now to submit these questions to a deliberate examination. 

Then he really becomes precise and defines the scientific question, which he the actually 
answers: 

The phenomenon of the production of motion by heat has not been considered from 
a sufficiently general point of view. We have considered it only in machines the 
nature and mode of action of which have not allowed us to take in the whole extent 
of application of which it is susceptible. In such machines the phenomenon is, in a 
way, incomplete. It becomes difficult to recognize its principles and study its laws. 

In order to consider in the most general way the principle of the production 
of motion by heat, it must be considered independently of any mechanism or any 
particular agent. It is necessary to establish principles applicable not only to steam- 
engineP but to all imaginable heat-engines, whatever the working substance and 
whatever the method by which it is operated. 

Carnot goes on to describe the workings of the steam-engine, and concludes: 

The production of motive power is then due in steam-engines not to an actual con- 
sumption of caloric, but to its transportation from a warm body to a cold body, that 
is, to its re-establishment of equilibrium an equilibrium considered as destroyed by 
any cause whatever, by chemical action such as combustion, or by any other. We 
shall see shortly that this principle is applicable to any machine set in motion by 
heat. 

We have shown that in steam-engines the motive-power is due to a re-establish- 
ment of equilibrium in the caloric; this takes place not only for steam-engines, but 
also for every heat-engine — that is, for every machine of which caloric is the motor. 
Heat can evidently be a cause of motion only by virtue of the changes of volume or 
of form which it produces in bodies. 

6 We use here the expression motive power to express the useful effect that a motor is capable of producing. 
This effect can always be likened to the elevation of a weight to a certain height. It has, as we know, as a measure, 
the product of the weight multiplied by the height to which it is raised. [Here, in a footnote, Carnot gives a clear 
definition of what we today call free energy, even though his concept of heat (or caloric) was inadequate] 

7 We distinguish here the steam-engine from the heat-engine in general. The latter may make use of any agent 
whatever, of the vapor of water or of any other to develop the motive power of heat. 
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Here, Carnot has unclear concepts about the role of heat, or caloric, in a footnote (see below) he 
evades the question. However, he is clear in the sense that a temperature difference is required if 
work is to be generated. In that process there is caloric or heat flowing from the hot to the cold, 
trying to re-establish thermal equilibrium. 

Then Carnot rephrases the problem he is considering: 

It is natural to ask here this curious and important question: Is the motive power of 
heat invariable in quantity, or does it vary with the agent employed to realize it as 
the intermediary substance, selected as the subject of action of the heat? 

It is clear that this question can be asked only in regard to a given quantity of 
caloric^ the difference of the temperatures also being given. We take, for example, 
one body A kept at a temperature of 100° and another body B kept at a temperature 
of 0°, and ask what quantity of motive power can be produced by the passage of a 
given portion of caloric (for example, as much as is necessary to melt a kilogram of 
ice) from the first of these bodies to the second. We inquire whether this quantity of 
motive power is necessarily limited, whether it varies with the substance employed 
to realize it, whether the vapor of water offers in this respect more or less advantage 
than the vapor of alcohol, of mercury, a permanent gas, or any other substance. We 
will try to answer these questions, availing ourselves of ideas already established. 

We have already remarked upon this self-evident fact, or fact which at least ap- 
pears evident as soon as we reflect on the changes of volume occasioned by heat: 
wherever there exists a difference of temperature, motive power can be produced. 

Here he announced the basic principle: A temperature difference is required in order to 
generate work. Then he presents the first sketch of the cycle: 

Imagine two bodies A and B, kept each at a constant temperature, that of A being 
higher than that of B. These two bodies, to which we can give or from which we can 
remove the heat without causing their temperatures to vary, exercise the functions of 
two unlimited reservoirs of caloric. We will call the first the furnace and the second 
the refrigerator. 

If we wish to produce motive power by carrying a certain quantity of heat from 
the body A to the body B we shall proceed as follows: 

(1) To borrow caloric from the body A to make steam with it — that is, to make 
this body fulfill the function of a furnace, or rather of the metal composing the 
boiler in ordinary engines — we here assume that the steam is produced at the 
same temperature as the body A. 

(2) The steam having been received in a space capable of expansion, such as a 
cylinder furnished with a piston, to increase the volume of this space, and 

8 It is considered unnecessary to explain here what is quantity of caloric or quantity of heat (for we employ these 
two expressions indifferently), or to describe how we measure these quantities by the calorimeter. Nor will we 
explain what is meant by latent heat, degree of temperature, specific heat, etc. The reader should be familiarized 
with these terms through the study of the elementary treatises of physics or of chemistry. 
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consequently also that of the steam. Thus rarefied, the temperature will fall 
spontaneously, as occurs with all elastic fluids; admit that the rarefaction may 
be continued to the point where the temperature becomes precisely that of the 
body B. 

(3) To condense the steam by putting it in contact with the body B, and at the 
same time exerting on it a constant pressure until it is entirely liquefied. The 
body B fills here the place of the injection water in ordinary engines, with this 
difference, that it condenses the vapor without mingling with it, and without 
changing its own temperature. 

Here, Carnot introduced several of the basic concepts of Thermodynamics: heat reservoir and 
thermodynamics process. In (1) and (2) he describes an isothermal process, whereas in (2) he 
describes and isentropic process. Reversibility reversibility is the next concept: 

The operations which we have just described might have been performed in an in- 
verse direction and order. There is nothing to prevent forming vapor with the caloric 
of the body B, and at the temperature of that body, compressing it in such a way as 
to make it acquire the temperature of the body A, finally condensing it by contact 
with this latter body, and continuing the compression to complete liquefaction. 

This then completes the Carnot cycle. However, Carnot continues in a fashion that is difficult to 
understand, and in contradiction with what he writes later. First the continuation: 

By our first operations there would have been at the same time production of motive 
power and transfer of caloric from the body A to the body B. By the inverse opera- 
tions there is at the same time expenditure of motive power and return of caloric from 
the body B to the body A. But if we have acted in each case on the same quantity of 
vapor, if there is produced no loss either of motive power or caloric, the quantity of 
motive power produced in the first place will be equal to that which would have been 
expended in the second, and the quantity of caloric passed in the first case from the 
body A to the body B would be equal to the quantity which passes back again in the 
second from the body B to the body A; so that an indefinite number of alternative 
operations of this sort could be carried on without in the end having either produced 
motive power or transferred caloric from one body to the other. 

Here, by the assumption that caloric is conserved, he also gets no work done by his cycle! Nev- 
ertheless he an-ounces his second principle: 

Now if there existed any means of using heat preferable to those which we have 
employed, that is, if it were possible by any method whatever to make the caloric 
produce a quantity of motive power greater than we have made it produce by our 
first series of operations, it would suffice to divert a portion of this power in order 
by the method just indicated to make the caloric of the body B return to the body 
A from the refrigerator to the furnace, to restore the initial conditions, and thus to 
be ready to commence again an operation precisely similar to the former, and so 
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on: this would be not only perpetual motion, but an unlimited creation of motive 
power without consumption either of caloric or of any other agent whatever. Such 
a creation is entirely contrary to ideas now accepted, to the laws of mechanics and 
of sound physics. It is inadmissible. We should then conclude that the maximum of 
motive power resulting from the employment of steam is also the maximum of motive 
power realizable by any means whatever. 

Since every re-establishment of equilibrium in the caloric may be the cause of 
the production of motive power, every re-establishment of equilibrium which shall 
be accomplished without production of this power should be considered as an actual 
loss. Now, very little reflection would show that all change of temperature which is 
not due to a change of volume of the bodies can be only a useless re-establishment 
of equilibrium in the caloric. The necessary condition of the maximum is, then, that 
in the bodies employed to realize the motive power of heat there should not occur 
any change of temperature which may not be due to a change of volume. 

Here he has two more fundamental concepts: There is am maximum work attainable that is in- 
dependent of what type of heat-engine is employed. Secondly he notes that any heat conduction 
results in a loss of work as compared with the work produced by an ideal heat-engine. The prob- 
lem is to understands how he reaches these correct conclusions, based on a cycle that produces 
neither work nor a transport of caloric (heat) from the hot to the cold reservoir. 

Let us follow his argument for the second demonstration: First the basic assumption: 

When a gaseous fluid is rapidly compressed its temperature rises. It falls, on the 
contrary, when it is rapidly dilated. This is one of the facts best demonstrated by 
experiment. We will take it for the basis of our demonstration. 

Then he goes on to describe in detail what we now call the Carnot cycle: 

This preliminary idea being established, let us imagine an elastic fluid, atmospheric 
air for example, shut up in a cylindrical vessel, abed (Fig. 1), provided with a mov- 
able diaphragm or piston, cd. Let there be also two bodies, A and B, kept each 
at a constant temperature, that of A being higher than that of B. Let us picture to 
ourselves now the series of operations which are to be described, Fig. 12.31 

This is the complete Carnot cycle. Carnot continues to explain that work is done: 

In these various operations the piston is subject to an effort of greater or less magni- 
tude, exerted by the air enclosed in the cylinder; the elastic force of this air varies as 
much by reason of the changes in volume as of changes of temperature. But it should 
be remarked that with equal volumes, that is, for the similar positions of the piston, 
the temperature is higher during the movements of dilatation than during the move- 
ments of compression. During the former the elastic force of the air is found to be 
greater, and consequently the quantity of motive power produced by the movements 
of dilatation is more considerable than that consumed to produce the movements of 
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Figure 2.3: (1) Contact of the body A with the air enclosed in 
the space abed or with the wall of this space — a wall that we will 
suppose to transmit the caloric readily. The air becomes by such 
contact of the same temperature as the body A; cd is the actual 
position of the piston. 

(2) The piston gradually rises and takes the position ef. The body 
A is all the time in contact with the air, which is thus kept at 
a constant temperature during the rarefaction. The body A fur- 
nishes the caloric necessary to keep the temperature constant. 

(3) The body A is removed, and the air is then no longer in contact 
with any body capable of furnishing it with caloric. The piston 
meanwhile continues to move, and passes from the position efto 
the position gh. The air is rarefied without receiving caloric, and 
its temperature falls. Let us imagine that it falls thus till it be- 
comes equal to that of the body B; at this instant the piston stops, 
remaining at the position gh. 

(4) The air is placed in contact with the body B; it is compressed 
by the return of the piston as it is moved from the position gh to 
the position cd . This air remains, however, at a constant temper- 
ature because of its contact with the body B, to which it yields its 
caloric. 

(5) The body B is removed, and the compression of the air is 
continued, which being then isolated, its temperature rises. The 
compression is continued till the air acquires the temperature of 
the body A. The piston passes during this time from the position 
cd to the position ik.(6) The air is again placed in contact with the 
body A. The piston returns from the position ik to the position ef; 
the temperature remains unchanged. 

(7) The step described under number (3) is renewed, then succes- 
sively the steps (4), (5), (6), (3), (4), (5), (6), (3), (4), (5); and so 
on. 
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compression. Thus we should obtain an excess of motive power — an excess which 
we could employ for any purpose whatever. The air, then, has served as a heat- 
engine; we have, in fact, employed it in the most advantageous manner possible, for 
no useless re-establishment of equilibrium has been effected in the caloric. 

Then he points out that the cycle may be run in reverse and thereby by the use of mechanical 
work take heat from the lower temperature of B to the higher temperature of the Reservoir A, 
and he continues: 

The result of these first operations has been the production of a certain quantity 
of motive power and the removal of caloric from the body A to the body B. The 
result of the inverse operations is the consumption of the motive power produced 
and the return of the caloric from the body B to the body A; so that these two series 
of operations annul each other, after a fashion, one neutralizing the other. 

The impossibility of making the caloric produce a greater quantity of motive 
power than that which we obtained from it by our first series of operations, is now 
easily proved. It is demonstrated by reasoning very similar to that employed at 
page [81 the reasoning will here be even more exact. The air which we have used to 
develop the motive power is restored at the end of each cycle of operations exactly 
to the state in which it was at first found, while, as we have already remarked, this 
would not be precisely the case with the vapor of waterP 

We have chosen atmospheric air as the instrument which should develop the 
motive power of heat, but it is evident that the reasoning would have been the same 
for all other gaseous substances, and even for all other bodies susceptible of change 
of temperature through successive contractions and dilatations, which comprehends 
all natural substances, or at least all those which are adapted to realize the motive 
power of heat. Thus we are led to establish this general proposition: 

The motive power of heat is independent of the agents employed to realize it; its 
quantity is fixed solely by the temperatures of the bodies between which is ejected, 
finally, the transfer of the caloric. 

We must understand here that each of the methods of developing motive power 
attains the perfection of which it is susceptible. This condition is found to be ful- 
filled if, as we remarked above, there is produced in the body no other change of 
temperature than that due to change of volume, or, what is the same thing in other 
words, if there is no contact between bodies of sensibly different temperatures. 

9 We tacitly assume in our demonstration, that when a body has experienced any changes, and when after a certain 
number of transformations it returns to precisely its original state, that is, to that state considered in respect to density, 
to temperature, to mode of aggregation-let us suppose, I say, that this body is found to contain the same quantity of 
heat that it contained at first, or else that the quantities of heat absorbed or set free in these different transformations 
are exactly compensated. This fact has never been called in question. It was first admitted without reflection, and 
verified afterwards in many cases by experiments with the calorimeter. To deny it would be to overthrow the whole 
theory of heat to which it serves as a basis. For the rest, we may say in passing, the main principles on which the 
theory of heat rests require the most careful examination. Many experimental facts appear almost inexplicable in 
the present state of this theory. 
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Here we are the final conclusion. The amount of work that may be extracted by a heat-engine, 
of any design whatever, depends only on the temperatures of the hot and the cold reservoir, and 
on the amount of heat transported. This conclusion is correct. However, the view that the caloric 
is conserved is clearly incorrect. The point is that the conservation of energy was only established 
much later. Carnot was clearly aware that his idea of heat was not clear as may be seen from his 
remarks: 

According to established principles at the present time, we can compare with suffi- 
cient accuracy the motive power of heat to that of a waterfall. Each has a maximum 
that we cannot exceed, whatever may be, on the one hand, the machine which is acted 
upon by the water, and whatever, on the other hand, the substance acted upon by the 
heat. The motive power of a waterfall depends on its height and on the quantity of 
the liquid; the motive power of heat depends also on the quantity of caloric used, 
and on what may be termed, on what in fact we will call, the height ofitsfall^that 
is to say, the difference of temperature of the bodies between which the exchange 
of caloric is made. In the waterfall the motive power is exactly proportional to the 
difference of level between the higher and lower reservoirs. In the fall of caloric 
the motive power undoubtedly increases with the difference of temperature between 
the warm and the cold bodies; but we do not know whether it is proportional to this 
difference. We do not know, for example, whether the fall of caloric from 100 to 50 
degrees furnishes more or less motive power than the fall of this same caloric from 
50 to zero. It is a question which we propose to examine hereafter. 

Carnot thought that caloric was a conserved quantity — an attitude consistent with the exper- 
imental accuracy of his day. The correct interpretation was first given by Rudolf Clausius in 
1850, with the formulation: 

dass in alien Fallen, wo durch Wdrme Arbeit entstehe, eine der erzeugten Arbeit 
proportionale Wdrmemenge verbraucht werde, und dass umgekehrt duch Verbrauch 
einer ebenso grossen Arbeit dieselbe Wdrmemenge erzeugt werden konne. 

2.4 The Maxwell's Distribution 

Maxwell read a paper at the meeting of the British Association of Aberdeen in September 
1859. It was published in the Philosophical Magazine in 1860, and it contains the following 

10 The matter here dealt with being entirely new, we are obliged to employ expressions not in use as yet, and which 
perhaps are less clear than is desirable. 

11 Maxwell, James Clerk; born June 13, 1831, Edinburgh, Scotland; died November 5, 1879, Cambridge, Cam- 
bridgeshire, England; Scottish physicist best known for his formulation of electromagnetic theory. He is regarded by 
most modern physicists as the scientist of the 19th century who had the greatest influence on 20th-century physics, 
and he is ranked with Sir Isaac Newton and Albert Einstein for the fundamental nature of his contributions. In 1931, 
on the 100th anniversary of Maxwell's birth, Einstein described the change in the conception of reality in physics 
that resulted from Maxwell's work as "the most profound and the most fruitful that physics has experienced since 
the time of Newton." 
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heuristic argument on the velocity distribution.^ 

If a great many equal spherical particles were in motion in a perfectly elastic 
vessel, collisions would take place among the particles, and their velocities would 
be altered at every collision; so that after a certain time the vis viva will be divided 
among the particles according to some regular law, the average number of particles 
whose velocity lies between certain limits being ascertainable though the velocity of 
each particle changes at every collision. 

Prop. IV. To find the average number of particles whose velocities lie between 
given limits, after a great number of collisions among a great number of equal parti- 
cles. 

Let N be the whole number of particles. Let x,y,z be the components of the ve- 
locity of each particle in three rectangular directions, and let the number of particles 
for which x lies between x and x + dx, be Nf(x)dx, where f(x) is a function of x to 
be determined. 

The number of particles for which y lies between y and y + dy will be N f(y)dy; 
and the number for which z lies between z and z + dz will be N f(z)dz where / 
always stands for the same function. 

Now the existence of the velocity x does not in any way affect that of the veloc- 
ities y or z, since these are all at right angles to each other and independent, so that 
the number of particles whose velocity lies between x and x + dx, and also between 
y and y + dy, and also between z and z + dz, is 

Nf(x)f(y)f(z)dxdydz. 

If we suppose the N particles to start from the origin at the same instant, then 
this will be the number in the element of volume (dxdydz) after unit of time, and the 
number referred to unit of volume will be 

Nf(x)f(y)f(z) • 

But the directions of the coordinates are perfectly arbitrary, and therefore this 
number must depend on the distance from the origin alone, that is 

mf(y)f(z)=^x 2 +y 2 + z 2 ). 
Solving this functional equation, we find 

f{x) = Ce Axl , <$>(r 2 ) = CV 7 " 2 . 

If we make A positive, the number of particles will increase with the velocity, 
and we should find the whole number of particles infinite. We therefore make A 
negative and equal to —\, so that the number between x and x + dx is 
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NCe -x 2 /a 2 dx 

Integrating from x = — °° to x = +°°, we find the whole number of particles, 
NC^/na = N , therefore C = ' 



f(x) is therefore 



OLy/% 

Whence we may draw the following conclusions: — 

1st. The number of particles whose velocity, resolved in a certain direction, lies 
between x and x + dx is 

N-^e^^dx 
2nd. The number whose actual velocity lies between v and v + dv is 

N-^v 2 e- v2 / a2 dv 

3rd. To find the mean value of v, add the velocities of all the particles together 
and divide by the number of particles; the result is 

, . 2a 
mean velocity = —= 
\/lt 



4th. To find the mean value of v , add all the values together and divide by N, 

mean value of v 2 = ^a 2 . 

2 

This is greater than the square of the mean velocity, as it ought to be. 



Chapter 3 

Basic principles of statistical mechanics 



3.1 Microscopic states 

Classical phase space: Classical phase space is 2/-dimensional space 

(qi,q 2 ,...,q f , Pi,p 2 ,---,Pf)- 

Here qi are positional coordinates, pi are momenta, f = 3N for n independent particles in 3- 
dimensional space. Each point corresponds to a microscopic state of the system. The simplest 
Hamiltonian of such a system is 

^=t^ n +E(quq 2 ,...,qf). (3.1) 
Motion of the system is determined by the canonical equation of motion, 

The motion of the phase point P t defines the state at time t. The trajectory of the phase space is 
called the phase trajectory. For a given initial conditions at some t — to, qo = {<?;o}, Po = {Pjo}> 
the phase trajectory is given by the functions qi(t 7 qo,po), pi(t : qo : po). 
For a conservative system energy is conserved, 

M(q,p)=E. (3.3) 

Thus the orbit belongs to the surface of constant energy. 

Exercise: Analyse phase space for a one-dimensional harmonic oscillator and find the de- 
pendence of its energy on the amplitude.. 

Quantum states: Quantum states \|// are defined by the Schrodinder equation , 

^ V/=J E /V/ (Z = l,2,...). (3.4) 
They are determined by the quantum numbers. We will discuss quantum systems later. 
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3.2 Statistical treatment 

Fundamental assumption: Let A be a physical quantity dependent on the microscopic state. 
In classical mechanics, 

A(q,p)=A(J>). 

In quantum mechanics, 

A,= jYiAm(dq) = (l\A\l). 

Here (dq) = Ily=i^7- The observed value (in a macroscopic sense), A b s raws? £e a certain 
average of microscopic A, 

^obs = ^ ■ 

Realization probability of a microscopic state: Let M be the set of microscopic states which 
can be realized under a certain microscopic condition. The realization probability that one of the 
microscopic states belongs to the element Ar of the phase space is defined as 

/ f(P)dr, (ATeM). 

J AT 

The probability that the quantum state I is realized is defined as 

/(/), (leM). 

f is usually called the distribution functions . 

The observed quantity is given by the formulas 



A obs =A = f A(V)f(V)dY, 



A = £>/(/). (3.5) 

M 

Statistical ensembles: great number of systems each of which has the same structure as the 
system under consideration. It is assumed that 

^obs = ensemble average of A = A . 

Example - ideal gas: The phase space consists of spatial coordinates r and moments p. In 
thermal equilibrium, at high temperature, and for a dilute gas, the Maxwell distribution reads: 



/(p) = (2%mk B T)- l / 2 exp 



P 2 

IrnksT 



(3.6) 



where T is the absolute temperatures, m the mass of a molecule, and k B is the Boltzmann con- 
stant. 
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General properties of statistical distributions 

Statistical independence: For two macroscopic and non-interacting subsystems, 

fadpMdqW^fldpMdqW fldp (2) dq^ - fn = fif 2 . 
Statistical independence means 

A~ 12 =AiA 2 , 

where A is any physical quantity. Thus, for any additive quantity, 



If one defines the fluctuation, AA = A — A, then 



N 



As a result, 



N 



((M) 2 } = U £M y I )=^((AAj) 2 ) 
((AA) 2 } 1 / 2 1 



N 



<1. 



Liouville theorem: Consider a set of instances, h,t 2 , ... ,. The states at that instances are rep- 
resented by the points Pi,P2,...,. The Liouville theorem states that the distribution function 
f(p,q) is time-independent. Indeed, in the absence of external forces, the state must be station- 
ary, and for the phase- space points one has 



div(/v) = 



E 

i=l L 



= o. 



Expanding derivatives we get 

/ r 

E 

!=1 



3/3/ 
dqt dpi 



f 

+/E 

(=1 



3<? ; | dpi 
dqt dpi 



0. 



According to the Hamilton equation (13.21) . 

dqi , 3p ; - 



+ dpi 



Thus 



0. 



dt L 

According to the Hamilton equation (13.21) the sum can be rewritten as 



.3/ df 

qi^-+Pi^- 
oqi dpi 



f 

E 



.3/ df 

qi^-+Pi^- 
dqi dpi 



f r 

E 

!=1 



df d"H df d!H 

dq t dpi dpi dqi 



(3.7) 



(3.8) 



This combination is called the Poisson bracket. 
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Role of integrals of motion Since log f(p.q) must be (i) stationary, and (ii) additive for macro- 
scopic subsystems of the system, 

log/l2 = log/l+log/ 2 , 

it depends only on additive integrals of motion, E(p.q), total momentum F(p,q) and angular 
momentum M.(p.q). The only additive function is the linear combination, 

logf(p,q) = a+V>E(p,q) +J-P(p,q)+l-M(p,q) . (3.9) 

Here in the equilibrium the coefficients p\ y and 8 must be the same for all subsystems in the 
closed system. The coefficient a is defined from the normalization condition. Thus, the values 
of the integrals of motion completely define statistical properties of the closed system. In the 
following we assume that the system is enclosed in a rigid box, and P = 0, M = 0. 



3.3 The principle of equal weight and the microcanonical en- 
semble 

An isolated system after some time reaches the equilibrium. The energy of the system, E, is fixed 
with some allowance, dE. In a classical system the set fM(E,dE) is the shell-like subspace of 
the phase space between the constant-energy surfaces for fH = E and H = E + dE. 

For quantum mechanics, it is a set of quantum states having energies in the interval E < Ei < 
E + SE. 



The principle of equal weight: In a thermal equilibrium state of an isolated system, each of 
the microscopic states belonging to fM(E,E + dE) is realized with equal probability: 



f(P) = constant = 
/(/) = constant 



dT 



E<?{<E+8E 



E<E[<E+SE 



-1 



PG M(E,SE), 
I E M(E,8E) . 



(3.10) 



This distribution is called the microcanonical one, the corresponding ensemble being called the 
microcanonical^ 

The microcanonical ensemble represents an isolated system which has reached thermal 
equilibrium. 



'Some other additive integrals of motion besides the energy can be important. 
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Classical limit (dE — > 0): One can take a set o(E) on the surface of constant energy. Then All 
the phase trajectories are concentrated at the surface 

X(p,q) = E, 

and the distribution function can be written as 



/(P) = const • h[H{p, q) - E] 
To determine the constant we have to calculate the integral 



D(E)= jdT8[^(p,q)-E} 



(3.11) 



(3.12) 



which is called the density of states, see below. It is very convenient to use the finite-width layer 
in the phase space and to transform variables from {p,q} to the element of surface o defined 
by the equality 9{{p,q) —E, and to the coordinate n along the normal to this surface. Then the 
energy is dependent only on the coordinate n, and 

69-C 

dE = —dn = \VM\dn. 
dn 



Here 



1/2 



(3.13) 



Consequently, 



,^or r, \ n d<5 dtl _ . , 

dTh[M{p,q)-E] = ^h(n). 



Then one can perform integral over n and introduce the distribution over the constant energy 
surface, 



f(P)da 



1 



do 



D(E) |V#] 
An average is then given by the equation, 

1 



, D(E) 



do 



(3.14) 



A(P) do 

D(E) Jx =E ~WW 



(3.15) 



Ergodic theorem: Originally, A b s is assumed to be time average of A(p f ). The ergodic theo- 
rem can be formulated as 

Atime average = Aphase average • 



Actually one can deduce the principle of equivalent weight from this theorem. 
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The finite allowance of the energy bE: In quantum mechanics, the energy of a system has 
uncertainty, 

(8E) qu ~h/t, 

where t is the length of the observation. The statistical treatment is still possible only if the set 
M \E,dE > (Sis)q U ] contains many quantum states. 

If the system occupies only a single quantum state, statistics is not applicable. 

3.4 The thermodynamic weight of a macroscopic state and en- 
tropy 

Variables defining a macroscopic state: One can choose the energy E (with allowance dE), 
the numbers Na,N b , ... of particles of various kinds, the volume V of the box which contains the 
system, and other parameters x, . . . which specify external forces. Thus the Hamiltonian depends 
on those parameters, !H = 9{[E(8E),Na,N b , ■ ■ ■ , V,x, . . .]. In a classical system one can tend the 
allowance dE to 0. It is effectively true also for a quantum system provided the measuring time 
is long enough. Then the following definition do not depend on dE. 

Thermodynamic weight: In quantum mechanics, the total number of quantum states, W(E,8E,N,V,x) 
of the possible quantum states for the set of prescribed values 

E(8E),N A ,N B ,...,V,x,... 

is called the thermodynamic weight of that particular macroscopic state. Namely 

W(E,dE,N,V,x) = £ 1. (3.16) 

E<E,(N,V,x)<E+8E 

In classical mechanics it is defined as a limit of quantum statistical mechanics 

r dT 

W{E,dE : N,V : x)= / s • ( 3 - 17 ) 

V ' ' ' ' JE<^(N,V,x)<E+8Eh 3 ^+ N B+-)N A \N B \... 

Here h is the Planck constant. 

Statistical definition of entropy: 

S(E,N A ,N B , ...,V,x,...)=k B logW(E,8E,N, V,x) . (3.18) 

This relation is called the Boltzmann relation while the constant 

k B = 1.38 x 1(T 23 J/K (3.19) 

is called the Boltzmann constant. To convince yourself that the statistical definition of entropy 
(|3.18l) is compatible with thermodynamics one has to check thermodynamic relations P 



2 Note that allowance 8E does not affect the value of the entropy 



3.5. NUMBER OF STATES AND DENSITY OF STATES 
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3.5 Number of states and density of states 

Let us chose the energies to be non-negative, 

< E\ < E 2 < . . . . 

The number of states between and E is called the number of states of the system: 



r(E,N,V,x)= £ 1. (3.20) 

0<E t <E 



In classical mechanics, 



r(E,N,V,x)= / s • ( 3 - 21 ) 



h<<X<E h 3 ^+ N B+-)N A \N B \ 
State density: 

D(E,N,V,x) = —T(E,N,V,x). (3.22) 

If allowance 8E is small, 

D(E,N,V)bE = W(E,§E,N,V,x). 

Correspondence of classical and quantum mechanics: It is important to keep in mind 

(i) Uncertainty condition, 

ApAq ~ h. 

Because of that the classical phase volume Ar corresponds to AT/h? quantum states (/ is 
the number of degrees of freedom; 

(ii) Indistinguishability of identical particles: it is an important features of Bose and Fermi 
statistics. In the classical limit h^Oit leads to a factor l/TLA^'!- 

We shall come back to that point later discussing quantum statistics in more detail. Though the 
factor 1/AH arises only from quantum statistics, its necessity has been understood much earlier 
to make the entropy extensive quantity. 
After definition of number of states 

Another definition of entropy: Another definition of entropy can be formulated through the 
probability distribution. For a closed system, the distribution function can be written as a function 
of the energy, // = f(E t ). Then the required number of states in the region E,E + dE can be 
written as D(E) dE, while the energy probability distribution is 



(P(E)=f(E)D(E)dE. 
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Since / < P{E)dE = 1 and (P(E) is centered near the average energy, 

(P(E)AE*if(E)D(E)AEttf(E)W = 1. 

Thus 

S=-*log/(£) = -*(log/(E,)>. 
The distribution function / is constrained by the normalization condition 



(3.23) 



(3.24) 



The latter inequality follows from statistical independence. Indeed, \ogf{E{) must be an additive 
function of the energy (in general, also of other additive integrals of motion, P and M), 



As a result 



log/(£,) = a+p£/. 



log/(£) = (log/(E/)> = -£// log/(£ z ) . 



This expression is written for quantum statistics. In the classical statistics one has to remember 
the normalization factor [hf WjNj^ 1 for the thermodynamic weight. Thus one has to replace 



fl^^h f X\Nj\^f{p,q) 



in the argument of the logarithm to obtain 

S=- jdTf{p,q) log 
The entropy, defined in this way, is additive. 



h f [HNj\ )f(p,q) 



(3.25) 



Physical significance of entropy: Let us start with the microcanonical distribution, 
d<£ = const x8(E-E )-Y[dT a 

a 

= const x 5(£ - E ) ■ \[{dT a /dE a ) dE a 

a 

(after replacement dT a /dE a — > AT a /AE a ) 
= const x8(E-E Q )e s Y[dE a /AE a . 

a 

Here S = L a 5 fl , E = Y M E a . 

Partial entropy 5(£'i,£ , 2, • • •) must have maximum at E a = E a . Since these values correspond 
to the equilibrium state the entropy of a closed system in a state of complete statistical equilib- 
rium has its greatest possible value (for a given energy of the system). 



3.6. INFORMATION 
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The law of increase of entropy: If a closed system is at some instant in a non-equilibrium 
macroscopic state, the most probable consequence at later instants is a steady increase of the 
entropy of the system. 

This is the law of increase of entropy or the second law of thermodynamics. This law has been 
formulated by R. Clausius (1865), its statistical explanation was given by L. Boltzmann (1870). 
It has a character of assumption which cannot be rigorously proved because the equations of 
mechanics are time-reversible. 

If the entropy remains constant, the process is called reversible, if it increases the process is 
called irreversible. 

3.6 Information 

The definition of entropy in Eq. (|3.23l) . is directly related to the definition of the information 
measure. As an example consider the probability distribution for the number of 'eyes' that come 
up when throwing a fair die. The probabilities of the six possible states 1 1), |2), . . . , |6) are 
with i = 1 , . . . , 6. Small variations df, lead to a variation in S as defined in (|3.23l) . The maximal 
value of S may be found, taking into account the constraint (13.241) . using a Lagrange parameter 




fi = exp(-l -X) =>- fi = \. (3.26) 

o 

Here we have chosen X so that f satisfies the constraint (|3.24l) . We see that requiring the infor- 
mation entropy to have its maximum value leads to the result that f = l/ 6, independent of i — as 
expected for fair dice. 

When we throw two dice, we have many more possibilities. As before, the 'first' die has 
the possible states {|z)}, with i = 1,...,6. The other die has the states {\j)} with j= 1,...,6, 
of course. Counting the eyes for the pair of dice we have 36 possible outcomes {|oc}}, with 
a = 1 , . . . , 36 corresponding to the states 1 1 1 ) , 1 1 2) , . . . 1 66) . With the argument developed above 
we will find that f a = 1 /36. It is important to note, however, that the statistical independence of 
the two dice allows another approach. 

The states |oc) = \i)\j) are in a product space of the two independent states \i) and \j), much 
in the same way that the position of a point in the plane r = (x,y), is given in terms of the 
independent coordinates x and y; or with our notation |r) = \x)\y). The process of throwing the 
dice yields eyes that are statistically independent, and the probability, fj, that the first die has i 
eyes and the second has j eyes is the product of the probability f for the first die to show i eyes 
and fj, which is the probability that the second die shows j eyes: 

fa = fij = fifj statistically independent (3.27) 
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It follows that the entropy of the combined system may be written 



s = A/ > .£./; ; in./;- / k^Afj^Afi 




= A/^y-ln./^./,- • *«£y> in /)£./;• 



j j 



where we have used that probabilities are normalized: Y*ifi = ILjfj = 1- We conclude that the 
(information) entropy of a system consisting of statistically independent parts is the sum of the 
entropies of the parts. Entropy is an extensive property, i.e. entropy is proportional to system 
size. 

3.7 Normal systems in statistical thermodynamics 

Asymptotic forms for the number of states and state density: 

(i) When number of particles N, or the volume V tends to infinity, the number of states in 
normal systems approach the following asymptotic behavior: 



r~exp[Ny(E/N)} 
T~exp[N\\f(E/N,V/N)] 



or exp[Vy(£/V)], 

or exp[V\\f(E/V,N/V)}, 



(3.28) 



and 



y>0, \)/>0, \|/'>0. 



(3.29) 



(ii) Therefore 



D(E) 

dD(E) 
~dE~ 



ar 

dE 



V exp(M|/) > 0, 



\|/ 2 exp(M|/) > 0. 



(3.30) 



Entropy of a normal thermodynamic system: For a normal system, the statistical entropy is 

S = k\og[D(E)AE}^k\ogT(E)=kN\\f. (3.31) 
It is proportional to N, or to V. 



Chapter 4 

Thermodynamic quantities 



4.1 Temperature 

Consider 2 bodies in a thermal equilibrium which are in thermal contact with each other but are 
isolated form the surrounding, i.e. form a closed system. Since both the energy and entropy are 
additive, we have 

E = E X +E 2 , S = S(E l ) + S(E 2 ). 

In the equilibrium the entropy has a maximum with respect to the parameters of subsystems. 
Consequently, dS/dEi = 0. Form this equality we get 

dS dS\ dS 2 dE 2 

dE\ dE\ dE 2 dE\ 
_ dS\ dS 2 _ 
dE\ dE 2 

Here we have used the energy conservation, E 2 —E — E\. As a result, 

dS\ dS 2 
dE\ dE 2 ' 

The absolute temperature is defined as T = dE/dS, or, more rigorously, 

T = (dE/dS) v (4.1) 

which means that the volume V is kept constant. In the equilibrium, T\ = T 2 . 

The previous argument may be generalized to a system consisting of many parts. At equilib- 
rium one concludes that dS/dE has the same value everywhere. Therefore one finds that absolute 
temperature T, defined as the change in the (equilibrium) entropy with energy is independent of 
position for a system in thermal equilibrium; it is also the same for two systems in equilibrium 
with each other, for example for a liquid in equilibrium with its vapor. In Eq. (|4.1I) we have ex- 
plicitly written that the change is to take place at a fixed volume. Volume changes are discussed 
in the section 1431 
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Now let us discuss the case when the bodies and not in an equilibrium with each other, 
T\ ^ T% During the equilibration the entropy S = S\ + S2 must increase, 

dS dSi dSj 
dt dt dt 



dSi dE\ dS2 dEi 
dE\ dt dE2 dt 



Since the energy is conserved, 



dS 


(dS x 


dS 2 ^ 


1 dE\ 






1 dE\ 


dt ~~ 


\dEi 


dE 2 1 


' dt 






' dt 



>0. 

If T2 > T\, then dE\/dt > 0, dE2/dt < - energy passes from bodies at higher temperature to 
bodies at lower temperature. 

The temperature is measured in degrees Kelvin, the number of Joules per degree is called the 
Boltzmann constant, see Eq. (13.191) . Below we omit the Boltzmann constant in all the formulas. 
Then the temperature is measured in the units of energy. To get custom formulas one has to 
replace T — > k B T, S — > S/k B . 



4.2 Adiabatic process 

Consider a thermally isolated system under time-dependent force X, the classical Hamiltonian 
being M(p, q, t). Thermally isolated means that !H is dependent on the coordinates and moments 
of the molecules belonging only to the body in question. If the force is purely mechanical (we 
ignore the feedback to the force source from the system under consideration), then one can apply 
the law of increase of entropy to the body in question. 

Let us then assume that X varies in time sufficiently slovJ^ and expand dS/dt in powers of 
dk/dt. Up to the lowest order, 

dS ( dX\ 2 dS dX 

— A I I > — A 

dt \dt J dX dt 

Indeed, the 1st power is absent because entropy must increase with time. We obtain that at 
dX/dt — > the entropy tends to be ^-independent. Thus, the adiabatic process appears reversible. 

Using adiabatic process one can calculate mean values. For example, let us define the ther- 
modynamic energy as 

E = ^(p,q;X). 

Since d9{{p,q;X) /dt = dff{(p,q;X) /dt (that follows from the Hamilton equation), 

dE _ d?{(p,q;X) _ dlH(p,q;X) dX 
dt dt dX dt 

1 comparing to the relaxation time of the system 
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On the other hand, E is a function of the entropy, S, and of external parameter, X. Thus 

dE _ fdE\ dX 
dt \dX J s dt 

As a result, 

d^(p,q;X) = 



4.3 Pressure 

We have already mentioned that both the entropy and the energy are additive quantities, i.e. they 
are proportional to system size, and therefore do not depend on the shape for systems in thermal 
equilibrium. We may consider the entropy to be a function of energy, S(E), or equivalently the 
energy to be a function of the entropy, E(S), for the closed system, i.e. in the case when we have 
no external system or medium. Let us consider below the case where the system does not take 
part in a macroscopic motion. Then the energy E is equal to the internal energy which we will 
denote as U . Thus, in our case, U = 9{(p,q). 

Now, consider a process in which the wall of the container moves adiabatic, i.e. slowly 
enough for the system to stay in internal thermal equilibrium. A force F acts from the contents 
of the system on the container wall surface element, 8s. If the container wall moves a small 
distance, 8r, then work is done on the surroundings given by dW = F • Sr. This work must be 
equal to the change of the internal energy of the system. Consequently, the force acting on a 
surface element ds is 

dX(p,q;r) fdU\ fdU\ dV f^U\ 

dr ~ \dr) s \dv) s dr \dV J 

The magnitude of the force per area ds is called the pressure, 




(4.2) 



Combining definitions of the temperature and pressure, one can write 

dU = TdS-PdV . (4.3) 

This relation is often called the first law of thermodynamics . The pressures of the bodies in the 
equilibrium are the same (to preserve mechanical stability). ^ 
It follows from Eq. (|43l) that 




(4.4) 



2 This property can be violated in metastable states. 
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The first law (14.31) can be rewritten as 

dS=^dU+^dV, (4.5) 

and it follows that 




(4.6) 



It the microscopic expression for the entropy is known, this equation allows one to calculate the 
equation of state connecting P, T and V. 



4.4 Equations of state 

As we have seen, the systems like liquid or gas in an equilibrium can be described by state 
variables like temperature T, pressure P, or total volume V. They are not independent since the 
variables in equilibrium related by an equation of state. Usually it is taken in the form, 

p = p(y, T) . (4.7) 

Thus, only two variables can be assigned independently. The equation of state can be obtained 
either from experiment, or from microscopic theory. 

An ideal gas of N particles obeys the equation of state 

P = NT /V = pT (temperature is measured in energy units) (4.8) 

Here p = N/V is the gas density. 

For one mole of the gas /V equals to the Avogadro's number Na = 6.023 x 10 23 mole 1 . If T 
is measured in Kelvin, then T — > ksT, and the equation of state for 1 mole reads 

P = RT/V, R = N A k B = 8.314 J/(K- mole). 

Including interaction between particles in a simple approximate form leads to more realistic van 
der Waals equation, 

AT fN\ 2 No 2 „ m 

P= a \ - = - ap 2 . (4.9) 

V-bN \V J l-bp w 

The item bp in the denominator take care of particle repulsion at small distances, while the term 
p 2 allows for particle attraction at relatively large distances. 
The phase diagram of real gases can be obtained from the equation of state. In general, it has 
the form shown in Fig. 14.11 We will come back to phase transitions later where various phase 
diagrams will be discussed. 
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Critical point 




Gas 



Figure 4. 1 : Phase diagram of a real liquid-gas 
system. 



4.5 Work and quantity of heat 

Consider a closed system that consists of two parts - the 'system' and the surrounding medium 
or 'heat bath', Fig. 1431 

First consider the situation in which the system is thermally insulated from the medium. If 
the volume of the system changes by SV then the medium, which is has a pressure P (equal to 
the pressure of the medium), performs work on the system. 




Figure 4.2: A closed system consisting of a heat bath surrounding the system of interest, (a) - 
The surroundings work on a thermally insulated system by changing its volume by §V . The work 
done by the system is dW = —PdV. The increase in energy of the system is dU = dW = —PdV. 
(b) - The walls of the system conduct heat and in the process of changing the volume of the 
system the heat 8<2 enters the system, therefore the energy change is dU = dQ + dW. Together 
the system and the surroundings form a closed system 



We assume that W > when external forces produce work on the body in question, while 
W < if the body itself produces work. One obtains 



dW/dt = -PdV/dt 



when the volume changes in time. For a reversible process the pressure must be the same 
throughout the body. 
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If the body is not isolated thermally, then 

dE _ dW dQ 
dt dt dt 

where Q is the heat gained or lost by the body per unit time. Here E is understood as a whole 
energy of the body including macroscopic motion. For the body at rest E equals to the internal 
energy U. In this case, 

dQ dU dV 

— = \-P — . 

dt dt dt 

Assuming that the body is in an equilibrium corresponding to its energy and the volume at 
the instant, one can put U = U(S,V), 

dU dS dV 

— = T P — . 

dt dt dt 

Thus 

dQ_ T dS 
dt dt 

Note that dQ and dW are not complete differentials, i.e. that they depend on the way in which 
the states of the system change in time. 

One can imagine the situation when the pressure and temperature are constant throughout 
the body, while the state is non-equilibrium (say, chemical reaction in the mixture). Since this 
process is irreversible, one gets the inequality 

dQ <T ds (4 11) 

dt dt 

instead of Eq. (14.101) . If the systems goes from one equilibrium state to another equilibrium state 
through some non-equilibrium states, than 

SQ<T8S. (4.12) 
This relation can be considered as a form of second law of thermodynamics. 



4.6 Thermodynamics potentials 
4.6.1 The heat function (enthalpy) 

If the process occurs at constant volume, dQ = dU. If the pressure is kept constant, 

dQ = d(U + PV)=dH, H(S,P)=U+PV. (4.13) 



Since 



dU = TdS-PdV , dH = dU + PdV + VdP, 
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one obtains 

dH = TdS + VdP. (4.14) 

Thus, 

T = (dH/dS) P , V = (dH/dP) s . (4. 15) 

As a result, if the body is thermally isolated and the pressure is kept constant, then 

H = const. 

4.6.2 Helmholtz free energy and thermodynamic potential (Gibbs free en- 
ergy) 

Consider the work on a body in a reversible isothermal change of the state, 

dW = dU-dQ = dU-TdS = d(U-TS)=dF, F(V,T) = U-TS. (4.16) 
F is called the (Helmholtz) free energy. Since 

dU = TdS-PdV , dF = dU -TdS-SdT 

one obtains, 

dF = -SdT-PdV. (4.17) 

Thus, 

S=-(dF/dT) v , P=-(dF/dV) T . (4.18) 

Since U = F + TS 

U = F- T(dF/dT) v = -T 2 (JfPj y - 

Thus, if we know any of the quantities, U (S,V), F(T,V), or H(S,P), we can determine all the 
remaining thermodynamic quantities. Thus U,F and H axe called the thermodynamic potentials 
with respect to their variables. 

We still miss the thermodynamic potential with respect to P, T. Introducing 

G = U -TS + PV = F + TS = H-TS 

and using the equality 

PdV = d(PV)-VdP 

we obtain 

dG=-SdT + VdP -> S = -(dG/dT) P ,V = (dG/dP) T . (4.19) 
If there are other parameters, A,, the expression 
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should be added to all thermodynamic potentials. In this way we can obtain the expressions for 
the averages, 

dH{p,q;X) _ (dF\ (dH 
Ai — - ' 



If the parameters %i change slightly, the changes in the thermodynamic potentials are equal if 
each is considered for the appropriate pair of constant quantities, 

(W) s ,v = (SF)t,v = (5H)s,p = (5G) r , P . (4.20) 

This statement is called the theorem of small increments. 
Since 

dU dV dS 
dt dt dt 

at constant V and T we get dF /dt < 0, while at constant P and T dG/dt < 0. Thus at the 
equilibrium the thermodynamic potentials reach minima with respect to the variations of state 
with proper constant parameters. 



4.6.3 Dependence on the number of particles 

Since S and V are additive the internal energy can be written as 

U = Nf(S/N,V/N) 

since this is the most general homogeneous function of the first order in ./V, S and V. In a similar 
way, 

F = Nf(V/N,T), H = Nf(S/N,P), G = Nf{PJ). 

If one considers iVasa formal independent variable, then all the thermodynamic potentials ac- 
quire additional terms fidN, where 

- (dH\ (dF\ (dG\ 

^~ \MJs,v ~ \ dN )s,p ~ Wr.v " \MJp,t ' 

H is called the chemical potential. We easily find that G = N/j(P, T). Thus 

dn = - (S/N) dT + (V/N) dP . 

If one considers the volume is constant, but the number of particles as a variable, the independent 
variables are, say, T, N. Then it is convenient to introduce the new thermodynamic potential, 

a = F -/jN = F - G = -PV . 

Then 

da = -SdT-Nd/Li. 
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Sometimes Q. is called the Landau free energy. The number of particles can be expressed through 
Cl(T,V,fi) as 

N (d/*)r,v \^)r,v 
One can show that if 2 bodies are brought together and they can exchange by particles, then 

We can summarize the thermodynamic potentials in the table 14. 1[ 



Thermodynamic potential 


Notation 


Independent variables 


Differential 


Internal energy 


U 


S, V,N 


TdS-PdV + ndN 


Heat function (enthalpy) 


H 


S,P,N 


TdS + VdP + /udN 


Helmholtz free energy 


F 


T, V,N 


-SdT-PdV+/jdN 


Gibbs free energy 


G 


T,P,N 


-SdT + VdP+/jdN 


Landau free energy 


a 


T,V,ti 


-SdT -PdV -Ndn 



Table 4. 1 : Thermodynamic potentials (summary) 



4.6.4 Derivatives of thermodynamic functions 

The quantity of heat which must be gained in order to raise the temperature of the body by one 
unit is called the specific heat. We get for the cases of fixed volume and pressure, respectively: 

C v = T(dS/dT) v , C P = T(dS/dT)p. 

Another important response functions are the compressibilities, 

and the thermal expansion coefficient 



(x = V,P, or 5). 



A' 



1 fSv\ 

Usually, pairs of thermodynamic variables T,V and T,P are mostly used. If V and T are used 
as independent variables, the results can be expressed through the specific heat Cy(V, T) and 
through pressure P. If we know the equation of state, P(V, T), then we can calculate everything. 

Similarly, if P and T are used as independent variables, the results can be expressed through 
the specific heat Cp(P : T) and through the equation of state V = V(P, T). 

As an example of such derivation one can find the relation between Cp and Cy considering 
the internal energy U as a function T and V. Since 



TdS=(^-] dT + 



dV 
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we obtain assuming the pressure to be constant 

Cp = Cy + 



\dv J 



T. 



Let us also demonstrate how one can obtain relations between second derivatives of thermo- 
dynamic quantities. Since 



we have 



dC v \ d 2 S d 3 F d 2 fdF 

7—— = -7—— = -T 



dV J v dVdT dVdT 2 dT 22 \dV 



Now, since 



we get finally 



-P 



dF_ 
3V, 7 



(av)r r (^ 2 ). 



Consequently, this derivative can be calculated from the equation of state. Similarly, 

dC P \ fd 2 V 



dP J T \dT 2 y p 

that van be obtained using Gibbs free energy instead of the Helmholtz one (prove!). 
Calculation of derivatives from the equation of state 

The calculations are based on the so-called Maxwell relations. Consider a thermodynamic po- 
tential, J (X,Y), which depends on the independent variables X,Y. Then, df can be written 

as 

dj =R x dX + R y dY . 



Since 



one obtains 



Example: 



a 2 ^ d 2 ? 



dXdY dYdX 

dRA fdRy\ 

dYj x \dxJ Y - 



Other important relations (see derivation in Appendix A) arise from the properties of partial 
differentiations. Consider 3 quantities, X,Y,Z, related by the equation of state %{X,Y,Z) = 
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const. We can consider X, Y as independent variables, while Z = Z(X, Y). Another way is assume 
y,Z to be independent variables, while X = X(Y,Z). The relations between the derivatives of 
theses functions read 

(§) Z (1X(§)-' 

dX\ fdYY 1 



Any quantity (X, F), the differential of which can be expressed as 



From this expression we get 



x 



dZj Y \dX J Y \dZj Y 



and 

'^F\ fdf\ fdf\ fdY\ 



(4.24) 



dXj z \dX J Y + [dY ) x [dX J z (4 - 25) 

Equations (14.241) . (14.251) together with Eqs. (14.221) . (14.231) and the Maxwell relations are usually 
used for transformations and computation of derivatives from the equation of state. 

4.6.5 Examples 

Entropy: 

)t~\ )v' 



dVJ T dVydTJy dT \dV 
Here we have used the realtion dF = —SdT — PdV. Similarly, 

\dPj T ~ dP\df) P ~ dP\dP 



Internal energy: 



Here we have used the realtion dU = T dS — PdV . Similarly, 



du 

dP 
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ing relations (prove! 



) 



Cp — Cy 
Kp — Ky 
Cp/Cy 



(TV/K T )a 2 ; 
(TV/C P )a 2 ; 
Kp/Ks. 



(4.26) 
(4.27) 
(4.28) 



4.7 Principles of thermodynamic 
4.7.1 Maximum work and Carnot cycle 

Consider a thermally isolated system consisting of several bodies not in thermal equilibrium, see 
Fig. 14.31 The system may do during establishment of equilibrium. This work, as well as the final 
equilibrium state, depend on the concrete way which the system follows. 

Let the total original energy be Eq while the energy in the final equilibrium state is E(S). 
Since the system is thermally isolated, 



Here T is the temperature in the final state. Since the derivative is negative, the work decreases 
with increasing S. Since the entropy cannot decrease the greatest possible work is done when 
the entropy retains constant throughout the process. That means the reversible way. 

Now let us consider two bodies with different temperatures, T2>T\. If one brings the bodies 
into thermal contact, no work will be done since the process is irreversible. The entropy of two 
bodies will increase be {hE){\/T\ — 1 /Tij where dE is the energy transfer. To get a maximum 
work one has to accomplish a reversible cyclic process in a way to keep the bodies among which 
the direct energy transfer takes place at the same temperature. For that purpose one needs a fur- 
ther body (working medium). The working medium at temperature T2 is brought in contact with 
the "heater" and receives some energy isothermal. It is then adiabatic cooled at the temperature 
T\ and then adiabatic returned to the original state. The cyclic process is called the Carnot cycle. 

Carnot discussed a process that has four stages: 

1. The heat engine, at temperature T%, is brought into contact with the reservoir at T%, and 
receives the amount — 8E2 isothermally . 

2. The heat-engine is removed from the ^-reservoir, thermally isolated and undergoes an 
adiabatic expansion until its temperature is decreased to T\ . 

3. The heat-engine is put in thermal contact with the T\ reservoir, and gives off isothermally 
the energy dE[ at temperature T\ . 

4. The heat-engine is removed from the T\ -reservoir, thermally isolated and undergoes an 
adiabatic compression until its temperature is increased to Ti- The cycle is then, and the 
four stages may be repeated. 



W\ = E -E(S), d\W\/dS= (dE/dS) 



-T. 
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Figure 4.3: A thermally isolated system contains two parts at different temperatures Ti>T\. The 
two parts are connected via a heat engine that may perform the work \W\ on the surroundings 
outside the system, as the system approaches equilibrium, (a) - Initially the energy of the system 
is Eq. (b) - Finally the two parts have the same temperature T, and an amount of work was done 
on the surroundings. The energy of the equilibrium system is a unique function of entropy, E(S). 
Both E and 5 depends on how the equilibrium state was reached. 

The heat-engine performs work on the outside world during expansion, and receives work during 
contraction. 

To calculate the work one can ignore the working medium for which the initial and final 
states are the same. Since 

— 8U2 = —T2 8S2 , 8C/1 = T\ 85 1 , 8S2 + 85 1 = (reversible process) 

we obtain 

|8W| max = -8C/1 - 8C/ 2 = -7i 85i - T 2 85 2 = -(r 2 - 7\) 85 2 = |SC/ 2 |, • 

Consequently, the maximum efficiency T] = \ W\/{W2) is 

TW=(72-7i)/r 2 <l. 

Lord Kelvin realized that the Carnot cycle may be used to define an absolute scale of temperature 
- the scale used here. Since the efficiency T] max < 1 it follows that there is a lower limit of 
(equilibrium) of zero. The Kelvin scale therefore has a natural fixed point, absolute zero. Since 
T"|max depends only on the ratio T1/T2, there is an arbitrary scale factor that is fixed by setting 
T = 273.16 K for the triple point of pure water. With this scale one degree on the Celsius scale 
equals one degree on the Kelvin scale. 
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Work in an external medium 

Consider a body embedded into a large external medium having Tq ^ T, Pq ^ P where T,P are 
the temperature and the pressure of the body. Since the medium is large Tq and Pq are assumed 
to be fixed. We are interested in the maximal work |W| max done by the thermally isolated body. 
This work is equal to the minimal work W m \ n done by an external source on the body. The total 
change of the internaP energy, AU consists of the three parts 

(i) mechanical work W done by the external source; 

(ii) the work PqAVq done by the medium; 

(iii) the heat — Tq ASq gained from the medium. 
Thus 



Since 



AU = W + P AVo - TqASq . 

AV + AV = 0, AS + AS>0 
W> AU-TqAS + PqAV . 



For a reversible process, 



W min = -\W\ max = A(U - T S + P V) . (4.29) 
We come to the following conclusions. 

(i) If the volume and the temperature of the body remains constant and equal to Tq, then 
W mm = AF. 

(iii) If the pressure and the temperature of the body remains constant and equal to Po and Tq, 
respectively, then W m i n = AG. 

(iii) If no mechanical work is done and the body is left itself, the irreversible processes lead to 
the inequality 

A(U -TqS + PqV) <0. 

One can relate the minimal work W m i n with the deviation of the total entropy S t from its equilib- 
rium value S t (U t ). Indeed, 

dS t (U t ) u/ AU-TqAS + PqAV (T-Tq)AS-(P-P )AV 

AS t = — — W min = = . 

dU t Tq Tq 

To reach maximum entropy one should require T = Tq, P = Pq. 



We assume that there is no macroscopic motions as a whole. 
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4.7.2 Thermodynamic inequalities. Thermodynamic stability 



The vanishing of the 1st derivatives of thermodynamic quantities, though provide conditions for 
the equilibrium, like 7i = T2, P\ = P2, is only a necessary condition for an extremum and do 
not ensure that the entropy reaches the maximum. The sufficient conditions require analysis the 
second derivatives. 

As we have stated, the quantity 



has a minimum. Thus 



AU-TqAS + PqAV 



W-TqSS+PqSV >o 



for any small deviation from the equilibrium. Thus, the minimum work which must be done to 
bring the selected part from equilibrium to some other state is positive. 

Now we can expand the internal energy U(S, V) in powers of the variables, 



dS dV 2 



32 V) 2 + !^ 5 v + ^( 5 v)> 



as 2 v ' dsdv dv 2 

The 1st order terms provide T 85 — PSV, and we have 

32 V) 2 + 1^5, + ^(^O. 



as 2 v "~ y 1 dsdv 

Since dS and dV are arbitrary, one has to assume 



d 2 U 
dS 2 
d 2 U 
dV 2 



Since 

we obtain from Eq. (14.301) 
In a similar way, 

From Eq. (|4.32l) one obtains 



d 2 U d 2 U 

ds 2 dv 2 

d 2 U 



\dSdV J 



> 0, 

> 0, 

> 0. 



(4.30) 
(4.31) 
(4.32) 



fdT 



dS 2 



- 



d 2 U 
dV 2 



C v >0. 



dP 



T 



VK S 



>0. 



dv) 



s < VK s Cv 
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After some algebra (see the book by Landau and Lifshitz, §21) one can get from Eq. (14.321) the 
inequality 



Here we have calculated the conditions for thermodynamic stability. 
4.7.3 Nernst's theorem 

As we know, for normal systems S — > at T — > 0. This statement is called the Nernst's theorem. 
If it is true, 

C P = Cv=0 at r = o. 
One can obtain similar equalities for T = 0, 

(dV/dT) p = -(dS/dP) T = (Maxwell relation for G) 
(dP/dT) v = 
(Cp-C v )/C P = 0. 

The following useful formulas follow from the Nernst's theorem: 




S 




L 



T 



H 



H + 



CpdT , 



G 




4.7 'A On phase transitions 



The equilibrium between the phases requires 



Ti = T 2 , Pi=P2, /Ji =j"2- 



Along the the co-existence curve between gas and liquid, 



fig(T,P)= m {T,P), dn g {T,P)=dw{T,P). 



Introducing entropy per particle s = S/N and volume v = V/N we get 



—s g dT + v g dP = —si dT + vjdP . 



Consequently, 




coexist 
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where X = T(s g — j/) is the latent heat. This is the Clausius-Clapeyron equation. From the equa- 
tions of state for gas and liquid phases one can find the dependence P(T) along the coexistence 
line. The latent heat X depends on the temperature and vanishes at some temperature T c . At 
T = T c the two phases become identical. So the entropy changes continuously while its first 
derivatives change abruptly. We shall come back to phase transitions later in much greater detail. 
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Chapter 5 

The Gibbs Distribution 



5.1 Spin I in a magnetic field 



Let us start with a simple example. Consider N noninteracting localized particles with spin S = \ 
embedded in an external magnetic field H. The Hamiltonian is 

£ = — m • H = —m z H , m = 2/jS , 

H = e/2mc is the Bohr magneton. Since S z = ±%, 

e TU) = ^ H ■ 

Denoting n-jvn as numbers of states with spin up(down), respectively, we get for the energy 

E = -v(n ] -n [ )H, (5.1) 

with the normalization condition 

N = n ] +n [ . (5.2) 

The total magnetic moment is 

M = n(n ] -n [ ). 

Under the assumptions of the microcanonical ensemble (i. e. with fixed total moment M), the 
thermodynamic weight for the system is 

N\ 

W = — —. 



The numbers can be expressed in terms of E and M. Using the Stirling's formula,^ 

logn! ~ n Xogn — n + 1 at n^>\ (5.3) 



1 When N 1 one can replace = O^lnn as J^lnxdx = N\n(N/e). 
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we obtain 

S = N\ogN — n^ lognj — Mj logHj. 
Now we can express the quantities n-^n\ in terms of the energy E given by Eq. (I5.ll) as 



consequently, 



Thus, 



/jHNtE 



1 /8S\ 1 , pHN + H 1 , n t 

~ - l0 g rrxr r r = ^T7 l0 g — • ( 5 - 4 ) 



r V^/w 2 j"# vHN-H 2/uH b n t 



M = N/Jtanh — , % = ' 1 



T ' * V^/r r cosh 2 (jiH/T)' 

% is called the magnetic susceptibility. 

Now let us define the same relations from the canonical ensemble, i. e. assuming that the 
temperature is fixed by a thermal contact with a "thermal bath". Since the energy cost for one 
spin flip 

n T ->/i T -l, n^ ni + \ 
is AU = 2fjH and the entropy change is 

AS = lo § 7 7T77 rTTT ~ lo § i T = lo § 



(n T -l)!(n| + l)! n T !/ij! + 1 

we obtain 

AS 1 , nt 

— ~ log — . 

At/ 2ju# 5 «| 

That must be equal to the inverse temperature, and we recover previous results. 
The previous results can be summarized as a distribution function 

no = ^e-^ , Zi = £ ^ = 2 cosh^ . (5.5) 

Here (3= l/7\ We have 

£= — V £ c e pe ° = -ufftanh — , U=Ne. 

Now there exist fluctuations around the average energy which are absent in the microcanonical 
ensemble. 



Exercise: Calculate the fluctuation in energy, \f& — E 2 and compare it with the internal energy 
E = Ne. Show that the difference is small for a macroscopic body. 
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5.2 The Gibbs distribution 

Eq. (15.51) is the particular case of the Gibbs distribution. If there is a body, embedded into a 
medium, the microcanonical distribution can be written as 

dw oc S(£ + E' -E^dTdT 1 

where superscript "prime" relate the quantities to the medium. If one fixes the body in a given 
state n, then the probability to find the body in this state is 

r r rfV r p s '( e ') 

fn~ j8(E n + E'-E^)dr r = j8(E n + E'-E(°))^dE' = J e —S(E n +E> -E<®)dE' . 



As a result. 

e 



S>(E>) 



AE 



fn 

\ /\t/ i 

E'=E(°)-E„ 

Now let us consider the body as very small comparing to the medium. Then 



E n « - S'(E^-E n ) « S'(E^)+E n dS ^l = S>( E M) —E n /T . 

Finally, 

fn= l -e-* E », z = J>-P* p = i/r. 

Z s 

In a classical system, 



/(p, q ) = l e -m P ,q) 5 z = y C -PB(P,?) dr . 



Note that in the derivation we use the Hamiltonian of the whole system. 

The Gibbs distribution is relevant for a body in an equilibrium with a large medium - "thermal 
bath" . 

If the systems consists of non-interacting particles which have eigenenergies £ ? , 5th state 
being degenerate by g s times, then we arrive at the single-particle distribution function, 



Here Z\ is the single-particle partition function. 

The Maxwell-Boltzmann distribution 

Derivation from the Gibbs distribution 

Consider a system of non-interacting particles. Dividing the total energy into potential and ki- 
netic parts, 

E(p,q) = V(q)+K(p) 
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we can write 



f(p,q) = fq(q)-f P (p) 

For non-interacting particles the single-particle distribution is 

f p (p) = (2nmT)- 3 / 2 e-^ + "' + ^ 2mT . 

Exercise: Show that the average kinetic energy per atom is \T . 
Statistical derivation 

Consider particles with energy levels £ ; and degeneracy factor gu N — n,-. Here n,- is the number 
of particle occupying ith level. If the particles are identical and distinguishable the total number 
of microstates for a given state specified by the set {«,} is 

i 1 ' i 

The easiest way is to use canonical ensemble which specifies the temperature. Let us consider 
the transition from jth to z'th state, 

nt — *• Hi + 1 , n.j — > rij — 1 . 

Then 

AU = T AS = £,--£,-, (5.6) 

while 

+ l n n j~^ „ n J 

AC 1 Si Sj gi'gj gin, 

A? = l0g ( ni+ i) ! ( nj .-i) ! - l0g ^ = l0g i7^TT)- ( "> 

Comparing Eqs. (|5.6I) and (|5.7I) . we get 

8in J = e Wi-tj) 

Thus we arrive at the same result with Z = Z{ = Y*igi e ^ z ' where £, are single-particle energy 
levels. 
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Expressions for thermodynamic quantities 
Average single-particle energy: 

iv^.-pt, .__aiogZi(p) 



Entropy: Since the entropy is given by the relation 

S = -(log/„) = log/„ 

n 

we obtain in general 

S = \ogZ+U/T. 

The same result can be obtained from single-particle considerations. For N distinguishable 
particles we have 

S = logW « N\ogN-N + £(n/loggi-njlogn/) 

« AT logjV - V /if log ^ = AT log AT - TV flog ^ - (3eA 

= iVlogZi+t//r = logZf + U/T = logZ + U/T. 

Here we employ the fact that Z = Zf . If the particles are non-distinguishable, them one 
has to divide the thermodynamic weight by AH to obtain 

Z N 

Z=t^, S=- J £g s (f s logf s -f s ). 

Helmholtz free energy: 

f = u — ts = -riogz = -r log -J- 

5 AH 

This formula is fundamental in thermodynamic applications of the Gibbs distribution. Us- 
ing this formula one can express the Gibbs distribution in the form 

5.2.1 The Gibbs distribution for a variable number of particles 

If the body can exchange by particles with the medium, one has to specify the particle num- 
bers, N and N', respectively, so that N + N' = N^°\ Both the entropies and energies become 
functions on N, N'. As a result, we get 



f nN oc exp 



S\E^-E nN ,N^-N) 
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Next, we expand the entropy up to the 1st order in E nN and N. Since 
we get 

S'(E^ -E nN ,N( 0) -N) =S'(E<-°\nM) -VEtN + fyN 

(due to the assumption of the equilibrium, the temperatures and chemical potentials of the body 
and the medium are the same). Thus, 

f nN =Ae^ N - E " N K 

The normalization constant A can be expressed through the thermodynamic quantities. Since 
S = -(\ogf nN ) = - log A -faN + $E -> T\ogA = U -TS-fjN = Q, 

we obtain 

f nN = e^ a+ ^- E " N K 

Since 

N s N V s / 

one obtains 

a = -T\og J £(e^ N ^ EsN ) ■ 

N V s J 

Remember that for classical system of N non-distinguishable particles one has to use the classical 
Hamiltonian H{{p,q;N}) instead E n ^, the phase volume element being 

1 N 



while for distinguishable particles there is no factor l/Nl. Here d is the dimensionality of the 
real space. 



Chapter 6 
Ideal gas 



6.1 Classical gas 

Having in mind quantization in a box, 

\|/ n (r) = sin(k x x) ■ sm(k y y) ■ sm(k z z) , h = nm/L (m =1,2,...) 

we obtain 

£n= 2^Z? ( ^ + n >' + ^ ) - 



Thus, 



zi= £ e -(iwv/w j )(^) w ^1 T ^r^/^^^v/A 3 . (6.1) 



Here 



A = (2n$h 2 /m) 1/2 = h^2%/mToc T~ l l 2 



is the thermal de Broglie wave length. Another way to obtain this result is to use the continuous 
limit one can write 

Zl = v [ ^^ e -PP 2 A* 

1 J (2nny 

It is very convenient to introduce the density of states , 

Here g is the degeneracy factor of the state with given momentum p Now, the integral is easily 
done, to get 

Zi = VD Vf / y/xe~ x dx = V/A 3 . 
Jo 

Introduction of the density of states helps in calculation for different systems. 
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Exercise: Calculate the partition function for two-dimensional gas. 



Thermodynamic quantities 

Now we proceed with thermodynamics: 



F 
P 

U 

C v 
S 



-riog 

dF 

dv 



yN 



= -NT log(V/A 3 ) + T log AH ; 

at 



3F 
dN 



T.N 



T,V 



V 



pT (p is the gas density) ; 



rp 1 Zl PA 3 

t log — = r log — 



5 



logZ=-NT; 



(-) 



Zf £/ 
log — H = 



log pA^ 



(6.3) 
(6.4) 

(6.5) 

(6.6) 
(6.7) 
(6.8) 



Something is wrong: the entropy and the specific heat does not vanish at zero temperature. 
Indeed, the classical statistics is applicable only at 



pA 3 < 1 . 



(6.9) 



This inequality is violated at low temperatures. What was wrong in out derivation? We implicitly 
assumed that one state can either be empty, or occupied only by one particle. Indeed, according 
to Eq. (16.91) . the number of states V/A 3 is much greater than the number of particles, N. Only 
because of this assumption the equality 



yN 

zL 



holds. 

If the particles have internal degrees of freedom, k, with the energies then the free energy 
acquires an additional item, 

SF = -r/Vlog£e- pe *. 



Ideal gas with a constant specific heat 

In many important cases the specific heat can be regarded as temperature-independent. Using the 
Stirling's formufa for farge number of particles , N ^> 1, we can write the Helmholtz free energy 
as 



-AT log 



eV 
AW 



eV 

-NT log — +Nf(T), C v = -NTf"(T) 
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the assumption Cy = const(T) leads to the expression 

f(T) = -c v T\ogT-^T + eo, 

where cy = Cy/N, while C, c and £o are integration constants. C, c is called the chemical constant. 
We get, 

U = Ne + NcyT; 

G = NEo + NT log P - NcyT logT - N^ C T (since PV = NT) ; 

H = U+PV =Ne +Nc P T; 

S = Nlog{eV/N)+Nc v logT + (^ c + c v )T 

= -NlogP + NcplogT + ^ c + c P )N. 

As a consequence, we can derive the Poisson adiabatic, i. e. the relation between V, P, and T 
for adiabatic expansion of compression of ideal gas with constant specific heat. Since 

—N logP + Ncp log T = const 

one obtains 

T cp /P = const -> T"fP l -^= const, y=c P /c v . 

Here we employed the relation cp — cy = 1 (prove!) which is valid for the ideal gas. Since 
PV =NT 

TV J 1 = const , PV y = const . 

Polyatomic gases 
Vibrational degrees of freedom 

If any internal motion of the molecules is present, then the potential energy of the molecule po- 
tential energy can be expanded in powers of the mechanical displacements q from the equilibrium 
positions, 

r v 

V = £ + £ a ikmk ■ 
i,k= 1 

Here r v is the number of vibrational degrees of freedom. If the molecule contains n atoms, then 
the total number of degrees of freedom is 3n. If the atoms in the molecule are collinear, there 
are 3 translational degrees of freedom (for a molecule as a whole) and 2 rotational degrees of 
freedom, while 3n — 5 modes are left for vibrational motion. If the molecule is not a collinear 
one, then r v = 3n — 6. The kinetic energy depends on all 3n momenta. Consequently, the total 
energy and be written as 

£ = £ +fn(p,q), 

where fu(p, q) is a quadratic function of 3n momenta and 3n — 6 (or 3n — 5) vibrational coordi- 
nates. Thus we have the total number of variables / = 6n — 6, or / = 6n — 5. For a monoatomic 
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gas the total number of variables is 3 because coordinates do not appear in the expression for the 
energy. As a result, we obtain, 



F = -NT log 
Now we can transform the variables as 



e ■ e 



N 



I 



fn(p,q) = Tf„(jJ,j), dT = T l l 2 dT' . 



p = p'Vf, q = q'Vf 
In this way, we get 

F = -NT log (aV~^°T 1/2 /N^ . 

Expanding the logarithm, we get 

c v = l/2, c P = c v + l = (l + 2)/2. 

Thus a classical gas has a constant specific heat. We can formulate a rule: 

Each degree of freedom contributes T/2 (or kT/2 in ordinary units) to the average energy. 

Monoatomic ideal gas 

Let exclude the kinetic energy of translational motion and label atomic intrinsic levels as e' k . 
Denoting 

Z = Y d e~K 

k 

we obtain 

eV ( mT 





\ eV Z 




F = -NT log 


_M\ 3 


= -AT log 



N \2%h" 



3/2 



z 



In the simplest case, when the atoms are in the ground state with zero angular moment and spin, 
L = S = 0, then Z = e~$ e ° where £o is the energy of non-degenerate ground state. Starting the 
energy scale from £o we obtain: 

Z=l, c v = 3/2, ^. = (3/2)log(m/2^ 2 ). 

These results were obtained by Sackur and Tetrode in 1912. If only one of the angular momenta 
is non-zero in th ground state of the atom, then the situation is rather simple. Usually, in a ground 
state L = 0. while the total spin can be finite (e. g. vapor of alkali metals). Then Z = (25+ 1) 
instead of 1, and C,s = log (25+ 1). If both momenta are non-zero than there is a fine structure 
in the levels which can be compared with the temperature. If we label the energy by the total 
angular momentum /, then 

Z- = £(2/+l)e- pe -' 
J 

since each level with a given J is (27+ 1) degenerate with respect to directionds of J. This 
expression can be simplified at high temperatures, £/ C T, when e~$ £j ft 1. Then E/(27+ 1) = 
(2L+1)(25+1) and 

U = log[(25+l)(2L+l)]. 
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Diatomic gases 

In this cases additional rotational and vibrational degrees of freedom must be taken into account. 
Under some approximation, the energy can be written as sum to electronic, rotational, and vibra- 
tional contributions. In the simplest case of a singlet electronic state 

1\ h 2 



e vK = eo + h&o + - j + —K(K + 1) . 

Here ha>o is the vibrational quantum, v is the vibrational quantum number, K is the rotational 
quantum number, / = r^m\m,2/ (mi + m-2) is the inertia moment of the molecule. Thus, 



/ib 



00 

z M = £(2^+i) e -P^ +1 )/ 2/ , 

00 

2v» = £ e -PMv + i/2) 

v=0 



As a result, 



F = -NT log 



eV ( mT 



N \2nh 2 



3/2 



+ Ne +F ml + F wib . 



The 2 last terms are defined according to the definition 8F a = —NT log-Z^. Introducing the 
translational contributions to the specific heat and chemical constant as 

= k + k + U, = (3/2) log(m/2^ 2 ) , 
cv = c a + c ml + c vlb , c a = 3/2 , 
C P = c tr + c mt + c vlb + 1 . 

As an example let us consider the case of large temperatures, when T 3> h 2 /2I. Then one can 
replace summation by the integration to obtain 

2L= r(2K+l)e-^ K ^y 2 = 2TI/h 2 , c mt = 1 , ^ = log(2//fi 2 ) . 

Jo 

In this case 

cy = 5/2, cp = 7/2. 
In the opposite limit it is sufficient to retain the first two terms, 

Z mt =l-3e-^ 2 /< 

to obtain 



F rot = -3NTe-$ h /' , c mt = 3(h 2 jlT) 2 ^ ' 



IT 
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Note that above expressions are valid only for the molecules with the different atoms. 

If the atoms are equivalent, then at large temperatures two opposite directions correspond 
to the same physical state. As a result, the rotational partition function must be halved. The 
quantum case is more difficult and we do not discuss it. 

The vibrational degrees of freedom can be easily accounted by direct summation of geomet- 
ric series. Using the lowest vibrational level as the origin for the energies, we obtain 



ZL 



l-e~ 
NT log 



(taw 



1 



t/vi 



N 



-Mog 



-p/iCQ 



+N 



p7zco 



gPfiOO _ 1 ' 

Cv ' b ( e P^-l) 2 ' 

The graphs for the rotational and vibrational contributions to the specific heat are shown in 




Figure 6.1: Contributions to the 
specific heat from rotational (1) 
and vibrational (2) degrees of free- 
dom. Temperature is measured in 
2/ k units of H 2 /2I in the graph (1) and 

in units of hex) in the graph (2). 



0.5 1 1.5 

Reduced temperature 



Exercise: Calculate approximate expressions for the case of low and high temperatures and 
discuss their physical meaning. 
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Quantum Gases 



Statistics of identical particles 

Consider N indistinguishable particles moving in a common potential, 

Here p, = — z'/W,- and r, ore operators for the momentum and coordinate of the z'-th particle. Let 
us denote single-particle eigenenergies as £^ and the states as 

&Wk(ri) = ejtVjtCr,-) . 

Specifying the total wave function as *P S = Ili Y*,-( r «) we obtain E s = £,-8^ since the Hamiltonian 
is the sum of independent terms. 

Now we have to use the concept that the particles are indistinguishable. Introducing the 
permutation operator P which interchanges z'-th and j-th particle, r ; <-> r,. Then, one has to 
require 



0, or PttP^ x =tt. 



According to the quantum theory, the proper many-body wave function must be an eigenstate of 
the permutation operator, 

PV s = pV s . 

Since double permutation is just the identity operator, P 2 = /, we get 

P 2 = l -> P = ±l. 

The particles with p = 1 called the bosons, while the particles with p = — 1 are called the 
fermions. 

The antisymmetric wave function vanishes if two particles are in the same state. This property 
is called the Pauli principle. 

Example: Particles in a Harmonic Potential: Ignoring zero-point vibrations we have £ n = 
nh(H, n = 0, 1,2 — Then 

1 * = 



n=0 1 

For the Maxwell-Boltzmann (MB) statistics we have 



72 

7 MB _ 
^2 — — — 



Zf 1 1 



2! 2 (1 -x) 2 ' 

Note: The product Z 2 contains 1 configuration where 2 particles occupy the same state. By 
dividing this product by 2! we ascribe the weight 1/2 to this configuration. This procedure is 
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wrong from the point of view of quantum statistics. Indeed, bosons are allowed to occupy the 
same single-particle state, so the the diagonal term 



CO i 



1 -x 2 



must be added with the weight 1/2. 



Zl ~ Zl + 2°> 22 -(l_^)(l-^)- 

In a similar way, the diagonal term must be subtracted for Fermi-Dirac (FD)statistics, 

7FD _ 7 mb 1 n 7 fd _ x 

22 "2 ' 22 -(1-*)(1-* 2 )- 

The difference is negligible for 1 — x <ti 1 (large temperature). 



The Fermi-Dirac Statistics 

This statistics is based on the Pauli principle: 

Each quantum state cannot be simultaneously occupied by more than 1 particle. 
The particles obeying the Fermi-Dirac statistics are called the fermions. 

Derivation from a grand canonical ensemble 

Consider the system of particles with single-particle levels £ ; and degeneracy factors gi. If the 
state is occupied, then there are only gi — 1 states at the z-th level for the second particles, the 
number of available states for two particles being gi{g\ — l)/2. The factor 1/2 appears because 
the particles are non-distinguishable. For n ; particles we have 

w = T\ — — — . 

llni\{gi-m)\ 

Now we apply the conventional approach. Namely, consider a transition — ► n; + 1 . The energy 
change is £,-, the change in the particle number is AiV = 1, while the entropy change is (prove!) 

AS = log — — w log . 

Hi + 1 Hi 

Since 

TAS = AU -ftAN = Ei-n 

we obtain 

= gP^-/*) 
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As a result, the probability for a state i to be occupied is 



the normalization condition (which determines /j) being 



e P(e,— a*) + 1 



Derivation from the Gibbs distribution 

Consider the particles belonging to z'-th state. We have the general expression 

&i = -T log ("" e <) = -T log£ (e^-^y . (6.1 1) 
m Hi 

Now, since n, = or 1, we get 

&i = -T log (l+e^- £i ^ . (6.12) 

The following way is standard: 

3Q ; 1 

fi = ni = —^— = —^, c . (6.13) 

The total Landau free energy is 

Q, = -T log£ (l +e^~ £i A . (6.14) 
i 

The Bose-Einstein distribution 

For bosons the number of particles occupying any state can be arbitrary. A proper picture is 
gi boxes separated by g, — 1 walls. To count the number of configurations one can count the 
different grouping of gi — 1 walls and n ; bosons. As a result, 

w = n (n , + „-!)! «+* 
V /»i!(gi-l)! 

Consequently, 

fi=-= or \ • (6.15) 

We can derive this expression also from the general formula (16.1 II) by performing summation 
over rii from to °°. Using the properties of geometric series we obtain, 

C2,- = rin(l-e^- £i )) . (6.16) 

Again, we recover the expression (16.151) as = — It is worthwhile noting that Eq. (16.151) 
is applicable only if 

e W-^ K \ ^ A/<0 . 

We immediately recover the Boltzmann distribution at n,- <C gi by replacing (rii + gi — 1) ! by g'-' . 
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6.2 Ideal gases out of equilibrium 

Let us assume that we label the states of the system by the subscript i, the degeneracy factor and 
the occupation number of zth state being g, and respectively. Then the set {n{\ describes the 
state of the system if it is also out of equilibrium. Since the particles are independent, 

W = JjAT, 

i 

For the Boltzmann gas one can place each of n ; particles in one of the possible g, state. Then the 
number of different physical configurations is 

t±r i = g?/n i \. (6.17) 

As a result, 

S = In W = £ln(^//ij!) = £ (mlng, - Inn,!) . (6.18) 
Now we can use the Stirling's formula to get 

S = Y^nMegi/m) = Y^gifMe/fi) ■ (6-19) 

i i 

Here we have introduced the distribution function fj = nj/gi as the probability for zth state to be 
occupied. 

Let us now require that the entropy must be a maximum for the equilibrium state. Then 
the problem is to find // such that the sum (16.191) has the maximum value possible under the 
restrictions 

Vn/ = YLsifi = N (particle number conservation) , (6.20) 
Y £ i n i = £<?!' e !'./i' = E energy conservation) . (6.21) 



Requiring that 
one obtains 



d(S + iJ$N-$E)/df. = 0, 

gi(- Inf, + a + pe,-) =0 -> fi = e^-^ . (6.22) 

For the Fermi gas, not more than one particle can be in each state. Thus one has to count the 
number of way to fill n,- states from gi available ones, and Ar,- = gi\/ni\(gi — ni)\. Thus 

S = ~ J> [fMfi + ( 1 - fi) ln( 1 - ft)} . (6.23) 

Again (Check!), requiring this expression to have a maximum under conditions (16.201) and (|6.21l) 
we arrive at the Fermi-Dirac distribution (|6.13l) . 

For the Bose-Einstein statistics one has to calculate the number of ways of distributing n,- 
particles among g ; states. This problem can be mapped on the problem of distributing n, identical 
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balls among gj urns. Let us imagine that the latter are separated by by gj — 1 vertical strokes 
placed at intervals along the points. For example, the diagram 



represents 10 balls among 5 urns as { 1 , 3, 0, 4, 2}. The total number of places (occupied both by 
strokes and points) is then (gi + n\ — 1). The number of configuration is just the number of ways 
to choose g\ — 1 positions for the strokes. Thus, Ar, = ((gi + n\ — — 1)!, and 

S = J> [(1 + /») -fMfi] ■ (6-24) 

The expressions (16.231) and (16.241) tend to the Boltzmann formula (16.191) at rc,- <C gj since 
gi ! « ( gi - Igf , ( gi + m - 1) ! « ( gi - 1) Igf at m < g ; . 



Finally, let us specify the expression for the entropy of Bose gas at ft ^> 1 since we will need this 
expression later to discuss the Bose condensation. We have Ar ; m nf' /(gi — 1)! and 

S = £>ln(e/ ; )- (6-25) 



6.3 Fermi and Bose gases of elementary particles 

For elementary particles we have 

e=£, ,= (2, + l). 

Here g is the spin degeneracy. Thus the equation for the chemical potential has the form, see 
Eq. dO, 



V J w^w u ] e p( E -Ai) ±1 u J gZ-Rp±l" 

Here "+" stands for fermions while "-" stands for bosons. In a similar way, 

a = tVD T deVelog (l ±e^- £ )j = --VD J dee 3/2 f(e) . 

The second inequality is obtained using integration by parts. We recognize that 

f' CO 

Q = -(2/3)J>ei/i = -(2/3) J q D(e)ef(e)de=-(2/3)U. (6.26) 
Since £1 = —PV we arrive at the following relationship: 
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This result holds also for Boltzmann distribution. 

Using the substitution of the variables z = (3e we observe that 

Q. = -PV = VT 5 / 2 V[(iu/T) 1 

where T| is a function of a single variable. Since 

i = -U™) and » = 

V V\6T) Vll V v\dnJ TV 

the ratio S/N depends only on the ratio fj/T. 

If the process is adiabatic, then S = const, and jji/T must be constant. Consequently, 

VT 3/2 = const , PV 5/3 = const , T 5/1 P = const. 

The exponents, however, have nothing to do with the ratio of specific heats, cy/cp, since the 
conditions cp/cy = 5/3 and cp — cy = 1 do not hold any more. 

Equation of state 

The equation of state can be written in a parametric form: 

P(V,T) _ r z 3/2 dz 
DqT 5 / 2 ~ Jo <*-&«(r,v) ± i ' 

N(V,T) _ r z 1/2 dz 
VDqT 3 / 2 ~ Jo eHfc(r,v) ± i ■ 

We have to know some tips to calculate the involved integrals. 

In the limiting case of the Boltzmann gas, 1, one can expand 

— i &ete- z (lTete- z ±..) . 

e z-fo±\ V J 

The lowest approximation leads to the Boltzmann value of the chemical potential and to Clapey- 
ron's equation PV = NT (Check!). The next term provides proper corrections. From Eq. (16.261) 
we obtain 

where ^b i is the Boltzmann value for the Landau free energy. Substituting the Boltzmann value 
for the chemical potential in the second term and using the concept of small increments (|4.20l) 
one can express the free energy as 
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Finally, differentiating this expression with respect to volume we arrive at the equation of state: 

r 3 /2 N tf 



PV = NT 



1± 



71- 



2g V(mT)V 2 



(6.27) 



The conditions for the correction to be shall is naturally the same as for applicability of the 
Boltzmann statistics. Quantum effects behave and an additional attraction for bosons and as an 
additional repulsion for fermions. 



A degenerate electron gas 

For electron spin equals to 1/2, and g = 2s + 1 = 2. At zero temperature, one can approximate 
the Fermi function 

1 f 1 at £ < u 



JiV] gP(e-/i) + i ~ \ at e >// 
Thus there is a maximum energy 

/u\ t =o = £f = p 2 F /2m. 



Since 



we have 



AT pi 



4np 2 dp-V .,p 2 dp 



p F = (3% 2 ) l/3 (N/V) l/3 h, e F = (3% 2 ) 2/3 (N/V) 2/3 (h 2 /2m) . 



V 3n 2 h 3 ' 

Limiting the integration of the absolute value of the electron moments by pf we obtain 

U _ p 5 F _ 3(3n 2 ) 2 / 3 h 2 (N\ 5/3 
V ~ I0m% 2 h 3 ~ 10 m\VJ ' 
{3n 2 ) 2 / 3 h 2 (N\ 5/3 



m \V J 

To calculate specific heat at low temperatures one has to be able to find temperature-dependent 
corrections. Let us demonstrate the way to calculate these corrections. Consider 



/ = 



/(e) de 
o e P(e-ji) + ! ' 



where /(e) is an arbitrary function such that the integral converges. Introducing z = P(e — fj) and 
remembering that |3 = 1 /T we get 

I=T r fWi) f* fb-Tz) r fWz) 

J-fti e z + l Jo e~ z + l Jo e z +l 
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Now we can replace in the 1st integral 

1 



= 1 



e~ z + 1 e z + 1 

to obtain 

" Pa V.. , rr rf(M+Tz)-f(M-Tz) , r f{M-Tz) 

fru e z + 1 



7 = 7- r^-Tz^T n^ Z) -t*-T Z) dz+ I 
Jo Jo e z +l J$ 



dz. 



The last term is exponentially small since 3> 1 . Returning to the initial variables in the first 
term, we obtain 

7=rfl»)* +r r / fr +r '>-{fr- r '> , fc . 

Jo Jo e z + 1 

At low temperature one can expand the second integrand as 

/(A/ + Tz) - fill - Tz) = IT f'{ii) z + ^T 3 f'"(v) z 3 + ---. 



As a result, 



Jo ' 'Jo e z +\ 3 w Jo e z +l 

= £mde+ f^/'^ + ^^r (M) + -- (6-28) 



Now we can calculate temperature-dependent corrections to the thermodynamic quantities. Sub- 
stituting /(e) = £ 3 / 2 we get 



£2 = Qn - VT 



Since the second term is a small correction we can replace /j — > £f in that term. Using the theorem 
of small increments we find 

1 2 ^\ 2/3 /7l\2/3m 



2/3 

5 = yNT 



C = yAT 



-Y 

n) ' 

y\2/3 r 

A 7 / 



A degenerate Bose gas 

The chemical potential of bosons is negative. It is given by the equation 

*-^ 3/2 7 W ), 7 W =r^L. (6.29, 



V 2 l / 2 n 2 h 3 v ' v y Jo e z+x -l 
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It increases with the temperature decrease and reaches zero at the temperature Tq given by the 
equation 

n g(mr ) 3 / 2 

V W ' 
Since 7(0) = (y / 7r/2)^(3/2) where is the Riemann's ^-function, 

_ 3.31 ft 2 /N\ 2/3 

From Eq. (|6.29l) we obtain 

(pr ) 3 / 2 = /(p>|)//(0). (6.30) 

The ratio (z) = J(z) / /(0) is plotted in Fig. I6.2[ The dependence of the product versus $Tq 
can be easily found graphically from this plot. 




0.5 1 1.5 2 2.5 3 



Figure 6.2: Plot of the ratio f (z) = 
7(z)/J(0). Chemical potential can 
be found by graphical solution of 
Eq. (I6301 . 



What happens at 7 1 < To? The above equation is based on replacement of the summation over 
discrete states by the integration. This is not true for bosons because they can condense in the 
ground state with z k = 0. We omit this term in our integration because ^fz k = for the ground 
state. 

As a result, at T < Tq the particles with £ > are distributed according to the BE distribution 
with jj = 0, 

gm 3 / 2 V y/ede 
£ = 2Wh 3 e^-l 

The total number of such particles is 

gm 3 / 2 V r Vede AT fT\ 3/2 
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The remaining 



N E=0 =N 



1- 



To) 



3/2 



particles are in the lowest state with zero energy. The energy and other thermodynamic quantities 

can be obtained from general expression for Bose gas by putting n = 0. In this way we obtain 
(check!) 

U = 0J70NT(T/T ) 3/2 , 

C v = 5U/3T, 

F = U-TS=-(2/3)U = Q. (since) /j = 0, 

p = -(BF/dV) T = 0M5lgm 3 / 2 T 5 / 2 /h 3 . (6.31) 

Thus at T < Tq the pressure is T 5 / 2 and it is volume-independent. The reason is that the 
particles in the condensate do not contribute to the pressure. 



6.4 Black-body radiation 

Electromagnetic radiation which in a thermal equilibrium is called the black-body radiation. It 
can be expressed as gas of non-interacting photons. To achieve the equilibrium, photons must 
interact with some amount of matter which is able to absorb and emit photons. Thus we arrive 
at the situation with variable number of photons, and the chemical potential fi should be fixed. 
Since the free energy must be minimum 

we obtain 

£/ = 0. 

The photons are specified by the wave vector k (the momentum being hk) and frequencies oy^ = 
ck (the energy being /z(0k = hck), as well as by polarization. Since photons are transverse, there 
are 2 directions of polarization, and the one obtains for the density of states 



, , d 3 k „ , 4%k 2 k ra 2 da> 
(2%) 3 (2n) 3 n 2 c 3 

Here D(a>) = (0 2 /7i 2 c 3 . In this way we obtain 

G) 2 . . 
dn a = V^r^N(a)) d(0 
% l c i 



where 



N((0) = 
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is called the Planck distribution. The energy distribution is obtained by multiplication by ha> 
(Planck, 1900), 

dE a = V ~ r -FTZ a co , 

n 2 c 3 g pto _ i 

its low-frequency asymptotics is the Rayleigh-Jeans law, 

dE a = V * ~ d(0, 

7t z C J 

while the high frequency one, 

dE (0 = V^e-^ (a d(a, 

TZ z C i 

is the Wien 's law. 

The thermodynamic quantities can be derived in a usual way, e. g., 

F = T j~D{&) log (l = -4aVT 4 /3c. 

Here a = % 2 /60h 3 c 3 is the Stefan-Boltzmann constant. It temperature is measured in degrees, 
then 

a = n 2 k 4 /60h 3 c 3 = 5.67 x 10~ 5 g/sec 3 deg 4 . 
For other quantities we obtain, 

S = 16or 3 /3c , U = 4oVT 4 /c = -3F , C v = 16oVT 3 /c , PV = U/3 = AoT A /c . 

A body in thermal equilibrium with black-body radiation: Let us denote 

1 dE a hoo 3 



4nV do) 4n 3 c 2 (e^ ha -l) 



for the spectral density of black-body radiation per unit volume and unit solid angle. Then the 
energy flux density leaving each point of the body is cl^dodoo. The incident energy flux on unit 
area of the surface at an angle to the normal is therefore c'E a) cosBdo, do = 27tsin0<i0. Let us 
not define the absorbing power, i. e. fraction of the incident energy absorbed by the body, as 
A(t0, 0). Then the energy absorbed per unit time and surface area is 

c %sA ( CO , ) c o s d o d CO . 

For simplicity, we can also assume that the body does not scatter radiation and is not fluorescent, 
i. e. that reflection occurs without change in the angle and in frequency CO. If we also assume 
that the radiation does no pass through the body we arrive at the balance equation between the 
radiation density and the intensity of emission 7(co, 0) dod(£> in the same direction: 

^T7—^L; = CEm cos — > a universal function of CO and . 
A(co,0) 
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This is the Kirchhof's law^ If A(co, 0) = 1, i. e. if the body absorbs all the radiation, it is called 
the black body. Then 

7(00,0) = c£ co cose, -> 7 = J dod®J((£>,Q) = cU/4V = oT 4 . 

6.5 Lattice Vibrations. Phonons 

For small displacement on an atom from its equilibrium position one can expand the potential 
energy near its minimal value 



+ KS) S (*-*o) 3 + - (6.32) 



Ro 

If we expand the energy near the equilibrium point and denote 

we get the following expression for the restoring force for a given displacement x = R — Rq 



F = -^- = -Cx + yx 2 (6.33) 
dx 

The force under the limit F = —Cx is called quasi elastic. 

One-Atomic Linear Chain 
Dispersion relation 

We start with the simplest case of one-atomic linear chain with nearest neighbor interaction. 
If one expands the energy near the equilibrium point for the nth atom and use quasi elastic 
approximation (|6.33l) he comes to the Newton equation (see Fig. /reff-phl) 

n-t n n+f 

(+) 

— H a . m « « « 



.. ft Figure 6.3: 



mu n + C(2u n -u„-i-u n+ i) =0. (6.34) 

If there is scattering, then the Kirchhof's law can be formulated only for integrals over frequencies and angles. 
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To solve this infinite set of equations let us take into account that the equation does not change 
if we shift the system as a whole by the quantity a times an integer. We can fulfill this condition 
automatically by searching the solution as 

u n =Ae i{ > q " t) . (6.35) 

Immediately we get 

C0 m = 2y/C/m. (6.36) 

The expression (|6.36l) is called the dispersion law. It differs from the dispersion relation for an 
homogeneous string, oo = sq. The spectrum is shown in Fig. 16.41 Another important feature is 



CO = CO,, 



sin 



qa 




that if we replace the wave number q as 



q =q-\ 



where g is an integer, the solution (|6.35l) does not change (because exp(27lz x integer) = 1). 
Consequently, it is impossible to discriminate between q and q' and it is natural to choose the 
region 

--<«<- (6.37) 
a a 

to represent the dispersion law in the whole g-space. Note that there is the maximal frequency 
co m that corresponds to the minimal wave length X m i n = 2n/q max = 2a. The maximal frequency 
is a typical feature of discrete systems vibrations. 

Now we should recall that any crystal is finite and the translation symmetry we have used 
fails. The usual way to overcome the problem is to take into account that actual number L of 
sites is large and to introduce Born-von Karmann cyclic boundary conditions 



u n±L — n n ■ 



(6.38) 
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This condition make a sort of ring of a very big radius that physically does not differ from the 
long chainP Immediately, we get that the wave number q should be discrete. Indeed, substituting 
the condition (16.381) into the solution (16.351) we get exp(±iqaL) = 1, qaL = 2ng with an integer 
g. Consequently, 

271? L L 

q=—j, ~o<8<o (6-39) 
a L 2 2 

(it is convenient to consider L as a large even number). So, for a linear chain, the wave number q 
takes L discrete values in the interval (— %/a, %/d). Note that this interval is just the same as the 
Wigner-Zeitz cell of the one-dimensional reciprocal lattice. 

Density of States 

Because of the discrete character of the vibration states one can calculate the number of states, 
Z)((o), with different q in the frequency interval u), co + Jco. One easily obtains (check!) 

£(») = V^T=^- (6 " 40) 
n Jul-® 2 



It is divergent at u) — > a> m which is a feature of ID systems. The density of states D(a>) is shown 
in Fig. 16.51 




Figure 6.5: Density of vibrational states in a one-atomic 
chain. There is a singularity at the maximal frequency that 
is a typical feature of ID systems. 



Phase and Group Velocity 

Now we discuss the properties of long wave vibrations. At small q we get from Eq. (16.361) 

(ti = sq, (6.41) 

2 Note that for small structures of modern electronics this assumption need revision. Violation of this assumption 
leads to the specific interface modes. 
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where 



(6.42) 



is the sound velocity in a homogeneous elastic medium. In a general case, the sound velocity 
becomes ^-dependent, i. e. there is the dispersion of the waves. One can discriminate between 
the phase (s p ) and group (s g ) velocities. The first is responsible for the propagation of the equal 
phase planes while the last one describes the energy transfer. We have 



(0 



d(0 



sm(aq/2) 



dq 

At the boundaries of the interval we get s p 
transfer energy). 



aq/2 
s\ cos(aq/2)\ . 

(2/71)5 while s g 



(6.43) 

(boundary modes cannot 



Diatomic Chain. Acoustic and Optical branches. 

We use this case to discuss vibrations of compound lattices. The corresponding picture is shown 
in Fig. 16.61 





ill* * 














— a J 

.......... . ; . . .. 



Figure 6.6: On a two-atomic chain. 



One can see that the elementary cell contains 2 atoms. If we assume the elastic constants to 
be C\£ we come to the following equations of motion: 

m\u n = -Ci(w n -v M )-C 2 (M n -v n _i), 

m 2 v„ = -Ci(v„-w n )-C 2 (v M -w n _i). (6.44) 
It is natural to use once more the translation symmetry condition and search the solution as 

Un = A u e l(qan - at) , v n = A v e l ^ qan - at) . (6.45) 



After substitution to Eqs. (16.441) we get the set of equations for the constants A ( \ To formulate 
these equations it is convenient to express these equations in a matrix form introducing the vector 
A = ( A u A v ) and the so-called dynamic matrix 



D 



Ci+C 2 

mi 

Ci+C 2 e iaq 
ni2 



C\ +C 2 e 



-taq 



C1+C2 
m\ 



(6.46) 
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The equation for A has the form 



co 2 A-DA = 0. 



This is homogeneous equation; it has a solution only if 

det(co 2 i-D) =0. 
This is just the equation which determines the eigenfrequencies. We get 



<VAt 



(6.47) 



(6.48) 



_ IT _^_Qptical vibration branch . 




]::^Wiyi^i.;;;;:- 

















Figure 6.7: Dispersion laws for 
acoustic and optical phonons at 
d = C 2 = C. 



<2 



lTJl-fsin 2 f 



(6.49) 



where 



2 (Ci +C 2 )(mi + m 2 ) 9 1£ 

co = — , x = 16 

mim 2 



CiC 2 



_(Ci+C 2 ) 2 J L(mi+m 2 ) 2 



mim 2 



The frequencies C0i 2 are real because |y| < 1. The spectrum is shown in Fig. 16.71 We see a very 
important difference with the case of monoatomic chain: there are 2 branches (Oi 2 for a given 
value of q. 

The lower branch is called the acoustic branch while the upper one is called the optical 
branch. To understand the physical reason for these names let us consider the limits of zero and 
maximal q. We get 



C0 ac (0)=0 ; 

COopt(O) =co 0! 
So, we have the inequality chain 



co ac (*/a) = -^/l-Vl-Y 2 



co opt (7i/a) = ^/l + x /l -f. 



(6.50) 



co pt(0) = co > a> op t(n/a) > co ac (TC/a) > co ac (0) = 0. 
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Now we can discuss the structure of vibrations in both modes. From the dispersion equation 
(16.471) we get 

u„\ A u C 1 +C 2 e-^ a 



ac,opt 



V„ 



ac.opt 



A v (Ci +C 2 ) -miQ4 )0p t 



At very long waves (q — > 0) we get 



1 



m2 
mi 



(6.51) 



(6.52) 



So, we see that in the acoustic mode all the atoms move next to synchronously, like in an acoustic 
wave in homogeneous medium. Contrary, in the optical mode; the gravity center remains unper- 
turbed. In an ionic crystal such a vibration produce alternating dipole moment. Consequently, the 
mode is optical active. The difference between acoustic and optical modes is shown in Fig. 16.81 




Optica] mods* 




A6:bs:idiJ mode ' 



-*> k 



Figure 6.8: Acoustic and optical branches of 
vibrational spectrum. 



Vibration modes of 3D lattices 

Now we are prepared to describe the general case of 3D lattice. Assume an elementary cell with 
s different atoms having masses m\. Then there are 3 acoustic modes with frequencies vanishing 
at q — > 0. At low frequencies they correspond to acoustic waves in an elastic media. One mode is 
a longitudinal, while two others are transverse ones. The rest 3s — 3 ones are the optical modes. 

Specific Heat of Crystal Lattice 

From the classical statistical physics, the average kinetic energy per degree of freedom is 

h = T/2, 

the total energy being 
As a result, the total energy is 



£ £pot ^kin 2£) c [ n . 

[/ = 3^Vo-£ kin = 3i?r, 
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where R is the Rydberg constant while Nq is the Avogadro one. As a result, the specific heat is 

c v = 3R = 5.96 cal/K • mole. 

This relation is violated at low temperatures as far as the temperature becomes less than the so- 
called Debye temperature (which is for most of solids is within the interval 100-400 K), namely it 
decreases with the temperature decrease. To understand this behavior one should apply quantum 
mechanics. 

First let us recall the average energy for photons calculated previously. The average energy 

is 

e=^ + ficoiV(co), N ((o) = -^— 

where N(a>) is the Planck function. The first item is energy-independent while the second one is 
just the average energy of bosons with zero chemical potential. 

Now we have to recall that the proper excitations in a lattice are collective vibrations, phonons, 
the average energy being 

U = Y,n(Oj(q)N[(Oj(q)} = £ / Dj((o)h(oN{o)) da. 
j'q j ^° 

Here j is the number of the vibration branch. 

For acoustic modes we use the so-called Debye model. Namely, we introduce the average 
sound velocity so as 

1 1 / 1 2 



3 3 I 3 + 3 



and do the calculation of the density of states similar to the one for photons. As a result, we get 
The contribution of acoustic modes to the internal energy is 



U X = VD d(0 



o eP to - 1 

where the so-called Debye frequency is determined from the condition of the total number of 
modes to be equal to 3./V for all acoustic branches, 

r(o D 

3N = VD / (o 2 d&. 
Jo 

From this equation 

^ 2\ V 3 

67T\ ' (0 D 



m = so[— r \ , q D 
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where 1/q is the cell volume. The order-of-magnitude estimate for the maximal wave vector qo 
is Tl/a. So according to the so-called Debye model all the values of q are confined in a sphere 
with the radius qo- Usually, the Debye energy is introduced as 

© = h(D D = Hsq \ 

The typical value of this temperature can be obtained from the rough estimate a = 10 s cm, so = 
10 5 cm/s. We get (tip = 10 13 s , = 100 K. For optical modes, let us assume that co,(q) = co,o> 
i. e. that frequencies of optical phonons are q-independent. Then all the procedure is similar 
for harmonic oscillators with fixed frequencies. It is conventional also to introduce the energies 
corresponding to optical branches as ®j = /zcOyo- These energies (in degrees) are of the order 
of 10 2 -10 3 K. The quality of the Debye model is demonstrated in Fig. I6.9L where experimental 
DOS for NaCl is shown together with the Debye approximation. 





Finally, we get the following expression for the internal energy 



U = U + NT 



3£> 



3.v 



+ 1 



(6.53) 



where the Debye function (D(z) is 



Z>(z) 



3 f z x 3 dx 



(6.54) 



/o e x - 1 

At high temperatures, T ^> &j (and, consequently, T ^> 0) we get z 1 in Eq. (|6.54l) and then 
expand the integrand in powers of x. We see that ©(0) = 1. The item under the sum sign in Eq 
(16.531) are equal to 1, and we get for the sum 3s — 3. consequently, we get the classical expression 



£ = £o + 3sNT 
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that leads to the classical expression for the specific heat. At low temperatures we immediately 
see that optical modes give exponentially small contributions and we can discard them. At the 
same time, we can replace the upper limit of the integral in (|6.54l) by infinity. Taking into account 
that 

x 3 dx K 4 



o e x -\ 15 
we get 

% 2 VT 4 
U = U + ^ 

that leads to the following expression for the specific heat 



c v 



12k 4 /r x 3 







The Debye model is very good for low temperatures where only long wave acoustic modes are 
excited. The acoustic contribution to the specific heat can be expressed through the derivative of 
the Debye function. We have 

TV f®/ T x 4 dx 



3N \©J Jo e x -\ 

Temperature dependence of the specific heat according to the Debye model is shown in Fig. 16. 101 
One can see that really the border between the classical and quantum region corresponds to 




Figure 6.10: Temperature dependence of the 
specific heat according to the Debye model. 



0,2 0,6 ffi _T_ 



T < 0/3 rather that to T < 0. The physical reason is strong frequency dependence of phonon 
DOS. In real life, DOS behavior is much more complicated because of the real band structure 
effects. 



Chapter 7 

Statistical ensembles 



We have already discussed the Liouville theorem which can be expressed as 

~ dt 



dt 



. 3/ , . 3/ 
oqi dpi 



0. 



Because of the Hamilton equations, this equation can be re-written as 



d l = d l + y 

dt dt V 



dtt df dtt df 



|+{/^}=o. 



Here the Poisson brackets for the quantities A(p,q) and B{p,q) are defined as 

dAdB dBdA 



dqi dpi dqi dpi 



(7.1) 



Thus, for a stationary distribution we have {/, 9f} = 0. We observe that any function of the 
Hamiltonian 9f, f[9f(p,q)], satisfies the Liouville equation and can be a proper stationary dis- 
tribution. Different distributions correspond to different statistical ensembles! 



7.1 Microcanonical ensemble 

As an example, we have already considered the microcanonical ensemble. Let as define T(E,N, V) 
as number of states with energies < E for given N and V. In the classical mechanics we get 

r(E,N,V) = y 0<w<£ (2rt)3(^+«»+-)iV i4 !iV B ! . . . 

where 

'0, *<0 

®{x) = { 1/2, x = (7.3) 
1, x>0 
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is the Heaviside unit-step function. The many-particle density of states is 

D(E,N, V) = g = / (2nR)m Jl , NaW J IE- *(p, ,)] . (7.4) 
Consequently, the normalized distribution function is 

f{p ' q) = d(e!n,v) d[E ~ * {Pl q)] ' (7 ' 5) 

Since the entropy of a normal system is given by Eq. (13.311) . S(E,N,V) ~ logr(.E, N, V), we 
obtain 

T dE ° g TdE T(E,N,V) ' 

Now we can re-derive the equipartition principle for ideal gas as follows. Consider the auxiliary 
relationship, 

n ^\ - 1 f dT n ™h(E X) 
Pn Wn] ~ Dj (2nh)™N\ Pn Wn h{ ] 

= ~dJ T^Wl Pn Wn® {E -* ] ~* testation by parts ^ 

1 r dT , T 
= D/(2S^ ( £ -^ = D = r - 

Using this relation, we obtain 

K= {lm) = T 2- 
Another quantity which we shall need later is the so-called virial, 

9 = -y,1nPn = V,q>i^— ■ 
n n oq n 

For a 3D system with harmonic potential energy, V x Y^ik a ikQiQk, one can easily prove that 

(9) = 3NT . 

Free particles: Let us demonstrate the general principles using the gas of free particles. We 
have to be able to calculate the volume of the hyper-sphere, 

, n ( 3N 2 \ 

V n = J Y\d Pi ® f E - £ Zj- J = (2mE) m l 2 V n , (7.6) 



where 
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To calculate l/ n let us introduce an auxiliary function 



consider an auxiliary integral 



'(=1 



n/2 



(7.7) 



This integral can be also written as 



In = J d%e- Rl , R 2 = £x? 



(7.8) 



Since V n = V n R n we have d% = nV n R n ~ x . Comparing Eqs. ([777]) and CLU> we get 



n"l 2 = nV n J dRR n l e Rl 
Consequently, we recover old results, 

m v w 

D(E) 



K 



n/2 



(n/2)! 



(2%ny N [3N/2) 
dr v N 



(2mEf N / 2 ; 
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3N/2 



dE (2%h) 3N (3A72-1)! 



(2mE) 



3N/2-1 . 



S(E) = N{-+log 



V ( mE 



N \ 3%Nh z 



3/2 



etc. Then, we recover the equation of state. 



7.2 Canonical ensembles 



Suppose that there are other than the energy E integrals of motion, 



Q(q,p) = Ci = const. 



Since {C,9{} = any function f[9{(q,p),Ci(q,p)] can be a proper stationary distribution func- 
tion. Different choice of the system gives rise to different ensembles. 



84 



CHAPTER 7. STATISTICAL ENSEMBLES 



Canonical ensemble 

In this ensemble, the temperature, volume, and number of particles are fixed. Moving along the 



lines of Gibbs' method we have obtained the canonical distribution (Sec. 15.2 



* = y 



In classical mechanics, 



f{p,q) = 



where Z is defined by the normalization condition. Here the temperature is fixed, while the 
energy fluctuate around the average energy U. The fluctuations are given by the relation 

(A£) 2 = ^)-{Ef= l -^e-^~\\ZE s e-^ 



1 a 2 z (\ az 



zap 2 \zd$J apVzap 



1 dZ 



at/ 2 
W =TCv 



Grand canonical ensemble 

Now let as allow an exchange by particles with the surrounding medium. Along the Gibbs 
method, we have obtained (see Sec. 15.2.11) 

i oo oo 



N=0 



Again, 



u = -Y e n jw-**) = - 31og5 • 

S = -Y,fNs^Ogf Ns ~- 

Ns 



$(vN-U)-\ogZ. 



Here we have introduced the average particle number, 

N^Nf Ns = ^Ne^ N Z N = L^ 

Ns " N=0 



Introducing 
we get 



a = -riogs 



T,V 



(7.9) 
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Then is becomes obvious that Q. coincides with the Landau free energy since 

Q = U-TS-/jN=-PV. 
It is easy to derive the fluctuation in the particle number (check!), 



AN) 2 = (N 2 )-N 2 = -T 



T.V 



The latter expression can be converted into a more convenient form introducing the gas density, 
p = N/V, using the expression for N, 

_ N _ fdP 

P= V ~ [dfly , 



(ANY = TV (*) =TV(^] (»\ =TN P K T . 



Then we obtain, 



dfiJ T \dP J T \d/u 

Poisson distribution. An instructive exercise is to find the distribution of the particle number 
in a given volume V of an ideal gas. Since fy oc e^Y^i e~^ Em e^ N Z^ we get 



H — — 

For an ideal gas, 

Now, from Eq. (|7.9I) we have 

N= ^± = {v/A 3 )e ^ ^ Z = e\Z N x e^ N =N N . 

Finally, 

N N - 

A = ^-"- P.io) 

that is the famous Poisson distribution. 

Exercise. Find AN = a/ (AN 2 ) from the Poisson distribution. Derive an approximate expres- 
sion for Eq. (03) at N > 1 , \N-N\<^N. 
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Figure 7.1: On canonical ensemble with a fixed pressure. 



Other ensembles 

Consider the canonical ensemble with a fixed pressure rather that volume, the so-called pressure 
ensemble. The system is shown in Fig. 17.11 Here the integral of motion is the enthalpy rather 
that the energy. Then we come to the distribution function 

1 k 2 

f( q ,p) = —e-^, ti P = ?{(p 1 q) + — +PAh. 

Here k is the piston momentum while M is its mass. Zp is again the normalization factor. Simi- 
larly, we can define 



H = U+PV 
One can easily check that 



logZf 



V 



logZp 



G = -T\ogZ P . 

Now we can integrate out the kinetic energy of a piston an replace dh — ► dV /A to get 



dh 



_^ g -P/t 2 /2M = dV_ 

2nh ~ V M 



Vm —AA 



M 



'2nh z 
MT 



As a result, 



dV 
Vm 



e-^Z N (V,T). 



where Z/v(V, T) is the partition function calculated for fixed volume and fixed number of parti- 
cles. We observe that the pressure ensemble can be considered as Laplace-transformed canonical 
ensemble for fixed volume. Since for an ideal gas Z^ V N the distribution function for the 
volume occupied by the gas under a given pressure is 

f v = CV N e-V py , 

where C is the normalization constant (find it and express through V\) 

We can apply the above considerations to microcanonical and canonical ensembles to obtain 
the relation 

Z N (VJ) = JdEe^ E D{E), 
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where D(E) is the partition function for the microcanonical ensemble. 

To find the energy distribution in the canonical ensemble let us expand the function 

u{E) = -\og[D(E)e-V E ] = $E-S(E) 

up to the second order in the difference E — U and using the relation 

a 2 s_ap_ 2 
W-dE--^ /2Cv 

we obtain the energy probability distribution as 

$ 2 {E-U) 



f E oc exp 



2C V 

Exercise. Calculate the normalization constant. 



, (AE) 2 = T 2 C V . (7.11) 



7.3 Ensembles in quantum statistics 
Pure and mixed ensembles 

Let us consider a particle with spin S = 1/2. Quantizing spin along z axis, we find 2 basic states 

iD-(i). u>-(; 

Hence, 

4lt> = ^IT), s z \i) = - 1 -\i). 

Consequently, the operator S z in this representation can be expressed as 



S z 



1/1 
2 V -1 



while the conjugated wave functions are just the strings 

<r i = (i o) , a i =(oi). 

Consider now the the ensemble where the particles are quantized along different direction. Still 
the state can be expanded in eigenfunctions as 

9 

|0)=cos-| T) + sin-| |). 



Then we easily obtain, 



1/ 2 9 ■ 2®\ 1 



(S z ) = - cos --sin - =-cos0. 
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This state corresponds to the system polarized along the axis 

n = cosGe^ + sinGey. 
Here e is the unit vector. The operator S x in the representation used has the form 

Ax "2 V 1 J ■ 

We can easily show that 

(5 x ) = ^sinG. 

The above example where all the spins are polarized along a given axis is called a pure state. If 
the spins occupy different states with a given probability, the ensemble is called mixed. To see 
the difference with a pure ensemble let us consider a system there the probabilities for the states 
| |) and | |) are equal. Then, 

(Sa) = £ Wi{i\§ a \i) =0, 

f=ta 

for any direction, (S • n) = 0. For different probabilities wi this average is finite, but < 1/2. The 
maximum is reached only for a pure state where one of the probabilities is zero. 

Now we can describe the general picture for a mixed ensemble. The ensemble average is now 

(A) = ^ Wi (i\A\i) . 

i 

Expanding the states \i) is terms of any orthonormal basis, 

\i) = £ci|cc) 

a 

we rewrite the average as 

(A) = J>/£cjaCai(p|A|a) = £Ap a p a p. 
i ap ap 

Here Ap a = (|3|A|a)is the matrix element of the operator A, while 

Pap = J^w/CpjCai = 

i i 

is called the density matrix. It can be expressed as a matrix element of the density operator, 

p = J^w/|i)(i|. 

i 

Now the average can be expressed as 

(A) = Tr A p . (7.12) 

For a pure state, 

P = l¥)(¥l, P 2 = P, 
thus the density operator can have the eigenvalues or 1. 
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Density operator for spin 1/2 

Any 2x2 matrix can be generally expanded in the unit matrix, 1 and the Pauli matrices 

( 1 \ . f -i\ / 1 \ 

°*=^i oj' °y=\i o J' ° z= ^o -l )■ 

In general, we can write, 

£ = i(i+a-p), 

where 1 is the unit matrix, a = (6 x ,6 y ,6 z ), while P is called the polarization vector. We can 
easily show that Tr p = 1 (since Tr 1 = 2 and Tr 6, = 0). For a pure state one has to require 

P = cos0e x + sin0e y , 

while for a mixed ensemble P = |P| < 1. Pis called the degree of polarization. 



Density matrix for thermodynamic ensembles 

Since 



ih-\i) = 9{\i) 



we can show that 



dp dp i 

dt dt H 



0. 



Here [A,B\ = AB — BA is the commutator which in classical physics corresponds to the Poisson 
brackets. Now we can construct statistics similarly to the classical one replacing distribution 
functions by density operators. In this way, for canonical ensemble we obtain 

. 1 



, Z = Tr e -^ = J>-P £ «. 



The grand canonical ensemble is defined in a similar way, 



. 1 
P= ~ e 



For a microcanonical ensemble, in the representation of eigenstates |oc,-) belonging to z'th level 
the Hamiltonian can be written as 



Since tlitlj = 8^1% the projection operator IT, commutes with the Hamiltonian. Thus, for the 
system having the energy E t 

P = -j-n ; , w; = Trn ; . 

As usual, 

S= -Trplogp. 
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Examples 

Spin 1/2 in a magnetic field: 

9{ = —jd • B = -nBa z , 
where is the magnetic moment. Since 

n n - n n - 

(here we employ the fact that a 2k = 1, a 2fc+1 = o z ) we obtain 

p = X -e-$ k = l - [1 + d z tanh(foi8)] , (o z > = Trp6 z = tanhpV?. 
A free particle in a box with volume V: 

i/=p 2 /2m - (r|p|r') = ^(r|p')(p'k-PP 2 / 2 '"|p)(p|r'). 

p,p' 



Since 



we get 

/ r |5| r '\ - I t c -Vp 2 /2m+(i/h)p-(r-r>) _\( m -(m/2^ 2 )\r-rf 

{mV) Zj (2nhf e Z\2n$h 2 ) 
From the normalization conditions we obtain 

Z = Tre-^= fd 3 r(r\e-W\r) = ^, (r|p|r'> = ± e — Ir-r'l 2 /^ 2 . 



Chapter 8 
Fluctuations 



In this section we discuss some additional aspect regarding fluctuations. 



8.1 The Gaussian distribution 



Let us consider a closed system described by a microcanonical ensemble. 

Assume that x is some quantity of the subsystem, x = 0. At this point entropy has a maximum, 



Thus one can expand 



the normalized distribution being 



=-=0, ^<0. 
ox ax L 



x 2 

S(x)=S(x)-y-, 



w(x)dx= sH-e-^^dx. 
V 2% 



As 



we can write the result (the so-called Gaussian distribution) in the final form 



(8.1) 



(8.2) 



w(x)dx = — y= : = exp ( — z t ^ i dx. 



As x is small, for any quantity § 



~d 2 § 
dx 2 
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(x 2 ) 



x=0 



(8.3) 
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For several (n) variables we have 

w =Ae- ^ Y*W 2 , !w\[dxi=\. 

i 

The last equality determines the normalization constant A. In this way we get 



WlX) 



\j2 ex P (- \ E "Yam \ ) Y = det{y a } ■ 



(271) 

Now let us define thermal conjugates 

The averages (jCjXjt) can be easily calculated: 

/y r ( 1 \ « 

\ zn ) 1 J \ pq J s=l 

One can prove that it is equal to 8^,^ 

(xiX k ) = d ik . 

From that we get 

(xiXk) = (T l )ik, (XiX k )=y ik . 

Thus 

For statistically-independent fluctuations 

(r 1 k=o. 

Thus the distributions are uncoupled. 



1 Proof: Assume for a moment that the average xi — Xio 7^ 0. Then 

Ik)"/ 

After differentiation of this equation with respect to x x q and putting x/o = 0, x^q =0we obtain the above result. 



x i0 = / Y\dx iXi e-^^-^-^ . 

(Z%) J j 
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8.2 Fluctuations of fundamental thermodynamic quantities 

As the change in the entropy is proportional to minimal work to change the thermodynamic 
properties reversible the probability for a given configuration can be written as, see Eq. (14.291) . 



W oc e W ^' T oc exp 



AU -TAS + PAV\ 



1 



Regarding that all the quantities are the functions of S and V and expanding U in small deviations 
AS and AV from the equilibrium values, 



AU = TAS-PAV + 



1 



d 2 U 
dS 2 



d 2 U 



d 2 U 



{AS) +2 dsdv ASAV + ^ {AV) 



dv 2 



we get 



Thus 



, dU\ fdU 
ASA[ — ] +AVA 



dS 



w exp 



dV 



fAPAV -ASAT\ 



: (ASAT -APAV) 



2T 



1 



(8.4) 



This is the general formula to find fluctuations of various thermodynamic quantities, and below 
we give several examples in which different parameters are considered as independent. 



Examples 
Independent V and T: 



fdP\ fdP\ 
AP = — AT + — AV. 
\dT) v \dVj T 



Substituting these expressions in Eq. (18.41) . we get 



W oc 



Thus we reproduce previous results: 



(ArAV>=0, {{AT) 2 ) = T 2 /C V , ((AV) 2 ) = -T(dV /dP) T . 



(8.5) 
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Independent P and S: 



As 

we have 

and 

Thus 

As a result, 



, dT\ fdT\ T /dT\ 

AT = -— A5+U— AP= — AS + — AP . 
dSj P \dPj s C P \dPj s 

dH = TdS + VdP 
fdV\ d 2 H fdT 



\dS J P dPdS \dP 



<ASAP>=0, <(AS) 2 )=Q>, ((AP) / ) = - 
Fluctuations per particle: From Eq. (18.51) we get: 

Putting V = const we obtain 



((Aiv)^) = -^(ay/ap) r 



This formula can be re- written as 



N 2 fdV\ f d N 



Then 

N (d_N\ _N _ fdN\ fdP\ _ fdN 

\dPVj TN ~ V \dPj TV ~ \dp) T y \dp) T y~ V¥/ T> V 

Here we have employed the fact that the ratio N/V depends only on P and T (additivity principle). 
The second equality, 

N fdP^ 



-. 



V \dfi 



TV 
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follows from the formula 

da = -VdP= -SdT-Nd/j. 
Finally we arrive at a very useful formula 



dn J T V ' 

8.3 Correlation of fluctuations in time. 
Langevin method 

Consider correlation between the values of the quantity x (x = 0) at different instants. Such 
correlation is characterized by the average (x(t)x(t')). Since under stationary external conditions 
the average depends only on the difference t' — t one can define 

4>(0 = <*(0M0> • 

It is clear from obvious symmetry considerations that 

4>(j) = 4>(-f) • 

A proper definition for quantum mechanical case is 

§(t-t') = ^(x(t)x(t')+x(t')x(t)). 

Now let us consider a state of partial equilibrium characterized by a given value x. For simplicity 
let us also assume that x is a classical quantity. 

Now we are prepared to discuss the state far from the equilibrium, namely assume that x ^> 
a/ (x 2 ). If we assume that the state under consideration is determined only by the quantity x we 
can suggest that the rate x for restoring the equilibrium is some function of one variable x. The 
simplest function valid for small enough x is the linear one, 

dx/dt = -hc, X>0. (8.6) 

It is natural to assume that this equation is the same as the "equation of motion" for a macroscopic 
quantity x. To express this concept in a more mathematical form let us define the quantity t, x {t) as 
the mean value of x at time t > under condition that at t = its value was x. The quantity £, x {t) 
is defined through the conditional probability P(x' ' ,t'\x,t) to find the the value x' of the variable 
x under condition that at time t it was x. We have, 

^(t) = J dx xP(x, t'\x,t). (8.7) 

Consequently, 

<|>(0 = (x^x(t)) = J dxw(x)x ^(t) , t > 0. 
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For the values t, x 3> a/ (x 2 ) we obtain 

dZ lX (t)/dt = -XZ )X (t), t>0. 

Consequently, 

^ x (t)=xe- h -> 4>(?) = (x 2 )e-^=Y- 1 e- A/ , *>0. 

Here yis the constant which enters the Gaussian distribution, see Eq. (18.21) . In general, at 

§(t) =y- 1 e~W. (8.8) 

It the random quantity x is comparable with the mean square fluctuation one has to add the 
random force y to the "equation of motion" (|8.6I) for the fluctuation x, 

x = — Xx + y(t) . 

The correlation function (y(O)y(f)) must be defined in a way to provide correct expression (|8.8I) 
for (x(0)x(t)) at large x. To do that we find a formal solution of the above equation with some 
initial condition, 

x(t) = e- h f dxe Xx y(x) . 

The average (x(t)x(t f )) is then 

(x(t)x(t'))=e- X ^ f dt x f dt 2 e X ^{y(t l )y(t 2 )). 
J t J t 

This result must be independent of to provided X(t — to) 3> 1 and X(t' — to) ^> 1 . Thus we can put 
t = —oo. The only way to obtain (x(t)x(t')) dependent only on \t — 1'\ is to suggest that 

(y(h)y(t 2 ))=Cd(t l -t 2 ). 

Substituting this expression into Eq. (|8.8I) for (x(t)x(t')) for large t we get 

(y(h)y(t 2 )) = (2X/y) 8(h-t 2 ). 

The above result can be easily generalized for the case of several fluctuating quantities, x^. 
Similarly, we define 

<k(*' - 1) = (xi(t')x k (t)) , 4>fc(f) = fc(-f) . 

However, there is one more symmetry property which is a consequence of the invariance with 
respect to time reversalP Because of the time-reversal symmetry, 

<M0 =<l>ft(-0 =§ki{t). 

2 The system is assumed to be not in a magnetic field and not rotating as a whole. 
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There is an important remark here. We have tacitly assumed that the quantities x k are not affected 
directly by time reversal. However, these quantities can change sign under time reversal, like the 
quantities proportional to velocities. If both x ( - and x k possess such a property the above equation 
is valid, of only one of two changes its sign, then there is an additional "-" sign. 

The following generalization is straightforward. We introduce the matrix X ik instead of the 
scalar %. The fluctuations x k are to be determined from the set of differential equations 

Xi = -^ikX k + yi(t) (8.9) 
k 

with random forces yt defined by the correlation properties 

(y i (h)y k (t 2 )) = 2r\ ik 8(t 1 -t 2 ), f\ = %T l - (8-10) 

Matrix elements of f| are called the kinetic coefficients. Their physical meaning will be discussed 
in the next section. The scheme discussed above is called the Langevin method. Again, 

<t>*(o) = (rV (8.1D 



Simple example: Brownian motion 

Consider a particle moving in a liquid. It is subjected to collisions with liquid molecules. Due to 
such collisions the particle's velocity v changes in time according to the equation 

mvi = -VVi + fi(t) 

where V is the viscous friction coefficient while f t are random forces. Consequently, 

%=(v/m)S ik , yi = fi/m, y' 1 = tf(0))&ik = \{v 2 ) 5ft- 

Let us now consider a displacement x(/) = r(/) — r(0) and calculate (xi(t)xk(t)) for t > 0. We 
have 

( Xi (t)x k (t))= [ dhf dt 2 {vi{h)v k {t 2 )) = hik I dt\ f dt 2 {vi(t 1 )vi(t 2 )) = (xf(t))d ik . 
Jo Jo Jo Jo 

Here we employ the fact the different components of the velocity are uncorrelated. Now we 

employ the Langevin method to find the velocity correlation function 

{v i { h )v i {t 2 )) = (v})e-^\. (8.12) 

As a result, 

(*?(/)) = (v?) f dh P dt 2 e-^-^ + f dhe-^ 1 ^ 
Jo \_Jo Jt 2 

At large times, t ^> X -1 we obtain (in general) 

(jc?(0)=2D|/|, D = (v?)X _1 . (8.13) 

The kinetic coefficient D is called the diffusion constant. We will discuss its physical meaning 
later. At small times, (xf(t)) = (vf)t 2 that corresponds to ballistic motion. 
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Onsager relations 

The "equations of motion" 

M = -2^hk x k 

k 

have a deep internal symmetry. To reveal it let is express the r.h.s. through the thermodynamically 
conjugated quantities, 

x- ds 

OXi 

which were introduced earlier. We have 

(xiX k ) = d ik , (xiX k ) = (t _1 ) ik , (XiXk) = Jik ■ 
If Xi are comparatively small, 

^i=&rt, Jik = Jki- 

k 

The latest equation is a consequence of the fact that the coefficients are second derivatives of the 
entropy. Then we get, 

Xi = - JjlfcXjt, Tift = J^A-aCT 1 )/* = (% _1 )ft- 

k I 

The quantities T|ft are called the kinetic coefficients, they are just responses to generalized forces. 
According to the Onsager principle, 

Tift = T|fa- • 

The proof of the principle is based on accurate application of time-reversal symmetry and the 
property ($x k ) = 8ft. 

If the system is embedded into an external magnetic field H, or it rotates as a whole with the 
angular velocity Q. then the time -reversal operation must include reversal of H or Q.. Then the 
Onsager principle reads 

r|ft(H) = T|fa-(-H) , Tift(n) = T| fa -(-n) . 

For proper application of the Onsager principle it is important to find proper thermodynamic 
forces Xi conjugated to the variables X{. A convenient way to do that is to study entropy genera- 
tion. Indeed, 

S = £a-xi = (8.14) 

i dXi i 

Thus, one can express the entropy generation through the heat release at a given temperature, Q, 
as S = T l Q and then express it through the quantities Xj in the form (18.141) . An example is given 
below. 
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Determination of proper generalized forces 

According to the general principle, one has to find the entropy production rate, S, and express is 
as — JjJCfX,-. Thus, 

* = --• 

dxi 

Let us consider an example. An external electric field E = — Vcp (where cp is the electrochemical 
potential) with combination of the temperature gradient create electric current with density j, as 
well as energy current w. The currents are conventionally expressed as 

j = aE-riVr, 
w = w-(pj = yE-pVr. (8.15) 

Our aim is to determine the corresponding thermodynamic forces, Xj and X w . Since the heat 
release per unit volume consists of the Joule heating j ■ E and of absorption — divw and in the 
linear response approximation divw = div (w — cpj) = divw, ™ we have 

div w f j • E 

dV+ / J —dV 



T 

Let us assume that the total heat flux through the surface is zero. Then the first integral can be 
calculated by integration by parts, and we have 

S = JdV w-vQ;J+^ =~JdV [w-X w +j-Xj] . 

Thus, the generalized forced conjugated to the currents j and w are: 

Xj = -E/r, X w = -V(l/T) = T 2 WT. (8.16) 
Compare equations (18.161) and (18.151) we arrive at the following matrix for kinetic coefficients: 

. _ / -or -r|7/ 2 

11 " V -rr -pr 2 

As a result, we have derived an important relation 

y = T]T. 

It can be shown that Onsager relations are also valid for the inverse matrix of kinetic coefficients, 

^(Xr 1 )-^- 1 . 

Exercise: 

1 . Analyze Onsager relations between the kinetic coefficients given by the equations 

E = pj-aVr, 

w-cpj = nj-xvr. (8.17) 

2. Express the coefficients p, a, n, x through the quantities a, T|, y, |3 and check the Onsager 
relations explicitly. 



3 Indeed, div cpj = (pdivj + j • Vcp w (pdivj = 0. 
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Dissipative function 

The problem of dissipation cannot be solved generally within statistical physics. However, a 
formulation becomes possible if one assumes that the state of the system is fully determined by 
macroscopic coordinates, Qi, and by the velocities, Qi- That means that high-order derivatives 
can be neglected. One has also to assume that the velocities are relatively small and high powers 
of Qi can be neglected, and that the motions consist of small oscillations around some equilibrium 
positions. 

Under that assumptions both kinetic energy, K(Qi), and the potential one, V(Qi), are quadratic 
functions of their arguments. One can derive the momenta in a usual way, 

P _ m&) 

Then we can express Qi in terms of Pj. In the absence of dissipation we come to the usual 
Hamilton equations of motion, 

dP, ' ' dQi ' 

Now let us consider the quantities Qi and Pi as fluctuating quantities Since the change in the 
entropy is equal to the minimal work, W m \ n = K(Pj) +V(Qi), divided by the temperature of the 
thermal bath, T, the generalized forces are 

Pi 
7" 

Qi 
T ' 

As a result, v\Q iPi = — T]/>.g ( = —T. The coefficients satisfy the Onsager relations because one of 
the quantities changes its sign under the time reversal. 

Now we can formally write the equations of motion which will allow for dissipative pro- 
cesses. In general, we can add to the r.h.s. of the Hamilton equations any linear combination 
of Xp n XQ t which possess the proper symmetry. However, the equation for Qi should be left un- 
changed because it is equivalent to the definition of momenta. On the other hand, the additional 
terms to the equation for Pi can contain only X Pi , otherwise the symmetry of kinetic coefficients 
will be violated. In this way we can write 

Now we can construct a quadratic form. 

ik 



x 1 dW mm = 1 dv 

Qi T dQi TdQ t 



X Pi = 



1 dW mm 1 dK 



T dPi TdPi 



8.4. FLUCTUATION-DISSIPATION THEOREM 



101 



which is called the dissipative function. The dissipative forces lead to the equation of motion 

dVjQi) 8g(ft) 

The energy conservation law has to modified as 
d 



^ \dK . dV . 

dt (*+v) = zy^^ 

r iQi 



pi+ 



ay 
aa 



Note that we applied the symmetry principle which has to be modified in an external magnetic 
field. For that case out approach is strictly speaking not valid. 



8.4 Spectral properties of fluctuations and fluctuation-dissi- 
pation theorem 

8.4.1 Classical systems 

Let us start with a classical system and discuss properties of Fourier transformed fluctuation, 

x{t)e mt dt -> x(t)= x a e- m ^. (8.18) 

-co J — OO ZJi\i 

If x{t) is real, then 

*-a> = 4- (8-19) 

Since 



(2lt) 

and it must be a function of t' — t, we have {x^x^) 5(t0 + to'). The proportionality coefficient 
is usually denoted as 2n (x 2 ) 

C0> SO 

(*„>*«/) = 27l(* 2 )a)5((0 + (0 / ) . (8.20) 

Obviously, 

(x 2 ) = <|>(0) = /^(*V (8-21) 
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The quantity (x 2 ) a is called the spectral density of fluctuations. From the known expression (|8.8I) 
for <])(?) we obtain^ 

[ )a ~ y((D 2 + l 2 )' 
We can introduce also transform of random forces, y a , 

(y 2 U=(a 2 + X 2 )(x 2 ) a = 2X/y. 

Again, the results can be expressed in the form of Langevin approach. For the correlation 
function of the Fourier components we obtain: 

Oww) = 2n(y i y k ) a d(QO + Qo') 1 (yiyk)(a = T\ik + T\ki- (8.22) 
Here y is the matrix of kinetic coefficients. 

Example: Fluctuations in one-dimensional oscillator. 

Consider one-dimensional oscillator which is at rest is in in the equilibrium position 2 = 0, but 
able to perform small oscillations in some macroscopic coordinate Q. We write the potential 
energy as U = (1 /2)iti(DqQ 2 where m is the "mass" while (Dq is the oscillator eigenfrequency. 
The generalized moment is then P = mQ. Since the minimal work against the "spring" is equal 
to the potential energy, W m i n = (\/2)m()i^Q 2 , 

f(Q) « e~ w ^ T = e - m <Q 2 l 2T , (Q 2 )=T/ma 2 . (8.23) 

If friction is present, the equations of motion acquire the form 

Q = P/m, (8.24) 
p = -m&lQ-yP/m, (8.25) 

where —yP/m = —yQ is the friction force. Now let us take Q and P as random quantities and 
determine the conjugated thermodynamic forces, Xq and Xp. They are determined by the entropy 
generation, i.e. by the minimum work to bring the system from the equilibrium to the state with 
given Q and P. We have 

W rmn =P 2 /2m + m& 2 Q 2 /2. 

Consequently, 

X Q = T- 1 dW min /dQ = T- l dU/dQ = m<a 2 Q/T, (8.26) 
X P = T- 1 dW min /dP = T- 1 dK/dQ = P/m. (8.27) 

Combining Eqs. (18.251) and (18.271) we get the fj -matrix has the form 

*=(° ~^)- (8-28) 

4 Note that according to general principles of quasistationary fluctuations this expression is valid for CO less that 
the inverse time for partial equilibrium to be established. 
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In order to apply these equations for fluctuations we rewrite Eq. (|8.25l) as 

P = -mGioQ-yP/m+y. (8.29) 

Equation (|8.24l) is just a definition of the momentum must remain unchanged. According to 
Eq. dOU), 

(/)co = 2r| 22 = 2y7\ (8.30) 
To calculate the required fluctuation spectrum (<2 2 )co we substitute P = mQ in (18.221) . obtaining 

mQ + yQ + m(£> 2 Q = y. (8.31) 

Multiplying by e~ m and integrating over time, we find 

(-mu) 2 - ioy{+ m(ol)Q a = y a , 

and finally, 

(Q 2 ) m = 



02 2 )o= 2( , 2 ^ 2 ■ 2 , . (8.32) 



8.4.2 Quantum systems 

Now let us turn to a quantum system. First, we have to remind some basic concepts of quantum 
mechanics to be able consider time-dependent quantities. 

Revisiting quantum mechanics 

According to quantum mechanics, the state of the system can be described by a time-dependent 
wave function *¥(t) satisfying the Schrodinder equation, 

ih(dW/dt) = 50V (8.33) 

where J{ is the Hamiltonian. The states which satisfy the stationary Schrodinder equation, 

ttM[ n {q)=E n M? n {q), (8.34) 

i.e. eigenstates of the Hamiltonian are called the stationary states. We will also use Dirac 
notations, 

y n (q) = \n),Y{q) = (n\- 
Since eigenfunctions of the Schrodinder equation form a complete set, 

J dqY n {q)Vn{q) = l. (8.35) 

For a stationary state, 

V n (t)=e-W E » t y Vn (q). (8.36) 
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In general, 

¥(0 = £a„¥„(0 = £«„ e - (// ^X|/ n (?) • (8.37) 
The mean value of any physical quantity, /, represented by the operator / is then 

/(0=L«n«m/»mW (8.38) 
nm 

where 

fnm(t) = jX(t)f^m(t). (8.39) 

Now, let us assume that the operator / does not contain time explicitly. Then using Eq. (18.361) 
we have, 

frm(t)=fnme i(a " mt , (8.40) 

where 

fnm = (n\f\m) = J dqYnNm{q) , co nm = - - . (8.41) 



8.4.3 The generalized susceptibility 

Let us now assume that the body is subjected to some perturbation, 

V(t) = -f(t)x. 

Then the average value 

f'OO 

x(t)= / a(x)f(t-x)dx. (8.42) 



o 

Consequently, 

x((0) = a(co) /((D) , (8.43) 

where 

POO 

a(co)= / dta(t)e i(0t . (8.44) 
Jo 

a(co) = a'(co) + ia"((o) is called the linear response function. Since x is real 

oc(cfl) = a*(— co), — > a'(co) = a'(-co), a"(co) = — a"(-co). 
For a periodic perturbation, 

V = - 

2 



y = -i[/ e -^+/* e ^]i, 



and 

x(q>) = X - [a{(n)fe- m + a(-(0)fe' m ] . (8.45) 
Then in general the dissipation is 
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Substituting x from Eq. (18.451) . 

f(t) = \[fe- m +fe' w ] (8.47) 

and averaging over time we obtain 

Analytical properties of generalized susceptibility. Kramers-Kronig relations 

Let us regard go as a complex variable, 00 = 00' + zoo" and consider the properties of oc(eo) in the 
upper half of the co-plane. From the definition (18.421) it follows that a(t) is finite at any positive t. 
Consequently, oc(co) is a one- valued regular function in the upper half of the co-plane. Indeed, for 
co" > the integrand of Eq. (|8.44l) contains the factor e~ M ' and since a(t) is finite the integral 
converges. The function oc(co) has no singularities at the real axis (co /; = 0), except possible at 
the origin. Note that the definition (18.441) is not valid for the lower half of the co-plane since the 
integral diverges at 00" < 0. 

The conclusion that oc(co) is regular in the upper half -plane is the consequence of the causality 
principle. It is because of this principle the integration over time in Eq. (18.421) is taken only over 
times previous to t. It is also evident from the definition (18.441) that 

a(-co*) = a*(a>). (8.49) 

Hence for a pure imaginary frequency, co = we have a(i(o") = a*(i(o"), i.e. oc(co) is real. 

The following theorem can be proved: The function oc(co) does not take real numbers at any fi- 
nite point of the upper half-plane except on the imaginary axis, where it decreases monotonously 
from a positive value (Xq > at co = iO to zero at co = In particular, it follows that oc(co) has 
no zeros in the upper half-plane. The proof is given in the book JT), §123. 

Let us now derive a formula relating the real and imaginary part of oc(co) . To do so, we choose 
some real positive value coo of co, integrate the expression oc(co) /(co — coo) round the contour C 
shown in Fig. 18. 1 L and then tend the outer contour radius R to infinity and the radii p of the inner 
circles to zero. 




Figure 8.1: On the derivation of analytical properties 
of the susceptibility. 



Since at infinity a — > 0, and the ratio ot(co) /(co — coo) tends to zero more rapidly than co . 
Since the function oc(co) is regular and possible divergence points co = and co = coo are excluded, 
the result must vanish, 

f , oc(co) 
4 d& v =0. 
Jc CO - co 
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The integral over the infinite semicircle is also zero, so we are left with the integral over the real 
axis and the parts around the (0 = and co = coo- The first part in not important since oc(0) is finite. 
The integration around coo yields — z'Tca(coo) since the direction is clockwise. Consequently, 

f r<°o-P , a(co) f°° , a(co) 1 , x n 
hm < / d& — —^+ d& — > - ma((Oo) = 0. 

P^O [J-,*, CO-COo J(Oo+p CO — CQo J 

The first item is just the principle value of the integral, so we obtain 

/°° (%( Q)) 
d(D K ' . (8.50) 
oo CO — COo 

Here the variable of integration, co has only real values. For convenience we replace the notations 

as 

CO — > £, , C0o ^ CO , 

to obtain the famous Kronig-Kramers relations (1927): 

1 r°° a"(t) 
a'(co) = -P / d^^^-, (8.51) 

K J-™ q — CO 

a" (co) = --P r^^®. (8.52) 
% j-oo q — co 

Since a"(co) is the odd function, Eq. (18.511) can be rewritten as 

a'((0) = -P r^|^^. (8.53) 



7X Jo ^ 2 - CO 2 

If the function oc(co) has a pole at co = 0, near which ot(co) = zA/co, then we get instead of 
Eq. (18321) : 

«» = --/> r d%^- + -. (8.54) 

7C J-oo q-CO CO 

The Kramers-Kronig relations are very important since they allow to reconstruct the whole re- 
sponse function from its real or imaginary part. This is a consequence of the causality principle. 

Quantum expression for susceptibility 

On the other hand,the probability for the transition n — > m according to the Fermi golden rule is 

w mn = y ^-k mil | 2 [5(co + co„ m ) + 8(co + co m „)] . (8.55) 
The total absorbed power due to all transitions from the state n is then 

|2 

2h 



7t COl/l 2 

Qn = ^C0 mn W mn = \ X nm\ 2 [§(C0 + C0 wm ) - 8(C0 + C0 mw )] . (8.56) 
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Comparing Eqs. (|8.48l) and (18.561) we write down the response functiorPa" for rc-th state as 

<(«) = -r^k 3m | 2 [5((o + (o, im )-8((o + a) m „)] . (8.57) 

m 

This quantity should be averaged over the Gibbs distribution of the initial states occupations, 

f n = Z- 1 e-V E ", as 

a" ((D) = Trpd = £/n<(co) (8.58) 

n 

where /„ are diagonal elements of the density matrix p = Z~ l e$^, see Eq. (17.121) . We have 

= t £(/«-/«) \ x nm\ 2 8((0 + a) Bm ). (8.59) 



Immediately, we get 

1 V -1 I i2 ft ~ fi 

T / , \Xnm I 

« fr aw - a) 



a' { to ) = - V \x nm \ 2 J " Jm , (8.60) 



or, in the complex form, 

a(a>) = \ V \x nm \ 2 fn ~ fm , (8.61) 



run 



8.4.4 Fluctuation-dissipation theorem: Proof 

According to quantum mechanics, one has to define a real quantity which is an average of a 
Hermitian operator, 

— {^Ccoj -W j = 2 l^co^co' + -^co'-^co J • 

Obviously, the correlation function must depend only on the time difference, and one can write 
down the spectral correlator as 

1 2 , 

-{XayXaf +x (a rx (0 ) = 2n(x ) (0 8((o + (o ) . (8.62) 

This relation can be regarded as a definition for (x 2 ) a . Using the definition, as well as the fact 
that (x 2 ) (o is real and is an even function of G) we get 



4>(0 = J ^ ^ * W - (4 = J z dttft) e 

In particular, 



5 a" is the imaginary part of the susceptibility. 
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The aim of the present section is to relate the spectral correlation function (x 2 ) a to the dissi- 
pation in the system. Let us consider a quantum body in a given state, say n. Then, the average 
value to the correlator is its diagonal matrix element, 

— (XayXa)' ~t~ -£(£>' -£co)nrc = ~ ^ [( x (j))nm( x oj)mn ~\~ (-^o/) nm{ x a) mn\ ■ 
1 1 m 

Here {x a ) nm is the Fourier transform of the nm matrix element of the operator x(t), 

/CO f'OO 
dt X nn i (?) € = I dt X nm € nm = 2,7lX nm &(($nm G)) ■ 

- OO J — OO 

Since x is real x nm = x* mn and 

S(gw + a))8(co mn + go') = 8(aw + co)8(co + a>') 
we can extract 2nd((D + Qo') at get: 

(jc 2 )co = 7T^|x nm | 2 [8((o + a)„ ra )+5((o + co m n)] • (8.63) 

m 

Again, the expression for the fluctuations should be averaged over the Gibbs distribution of the 
initial state occupations, /„ = Z~ l e~$ E ". Averaging, we obtain 

(x 2 ) a = 7iJ^/„|jc„ m | 2 [8(a) + a) nm ) + 8(a) + a) mM )] 

nm 

= ^^(/n + / m )k«m| 2 8(co + co„ m ) = 7t£/ n (l + e^'A \x nm | 2 8((0 + GD nm ) 

run nm 

= 7r(l+ e - pto )£/„|^ m | 2 8(a) + a)„ m ). (8.64) 

nm 

Now, let us note that Eq. (18.591) can be rewritten in the form 

a'» = j (l - e-V rm ) Yf n \x nm \ 2 b((D + (D nm ) . (8.65) 

Comparing Eqs. (18.641) and (|8.65l) . we obtain 

(x 2 ) a = W(©)coth(P«co/2) -> (x 2 ) = - /a"((o)coth(|3/tto/2)dco. (8.66) 

71 J 

This is the famous fluctuation-dissipation theorem (Callen & Welton, 1951). 
For small frequencies, when h($ <C T, one can approximate coth(|3/za)/2) as 

coth(p7zco/2) ^2T/ha. 

As a result, instead of (18.661) we get 

(* jo, = r . (8.67) 

00 
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Exercise: Check that fluctuations in the one-dimensional classical oscillator (example in p. I J 021) 
given by Eq. (8.32\) obey the classical limit dff.66D of the fluctuation-dissipation theorem. 

An important example is fluctuations of current density in a resistor. In this case xt = _//, a" = 
0)9ta((o), where a((o) is the complex conductivity. Thus 

(j 2 )ca = /?co9lo((o) coth 

Note that all the concept is valid only for small fluctuations near the equilibrium state. 

Exercise: 1) Find spectrum of fluctuations of the current I through the circuit shown in Fig. 18.21 
(/ 2 ) ra , for a fixed voltage V12 between the points 1 and 2) Calculate the integrated spectrum, 
J (I 2 ) a (d(0/2n) and compare it with the square of the average current, (I) 2 . 




o 



Figure 8.2: On the current fluctuations. L is the induc- 
tance, C is the capacitance, while R is the resistance. 
The circuit is kept under constant voltage V12. 
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Chapter 9 

Stochastic Processes 



Now we discuss other aspects of random processes which take place in course of evolution of 
nonequilibrium states to equilibrium. 



9.1 Random walks 

The simplest stochastic process is random walk in one dimension. A particle can make a step to 
the right with the probability p or to the left with probability q = I— p. 

We are interested to find the displacement S after N ^> 1 steps. It can vary between +N and 
-N. 

The probability of the walk with S = +N is Pn(N) = p N . If there occurs 1 step to the left the 
displacement is S = N — 2, the probability being Pn(N — 1) = Np N ~ l q because the step to the 
left can occur at any of the N different times (see Fig. 19.11) . In general, the probability to find a 

O » O ^ o — *o 

• »• < - " • " • » C 



Figure 9.1: On the ID random walk. 



walk with R steps to the right from total N steps is 

AH 



This distribution is called binomial or Bernoulli. Certainly 

N 



^P N (R) = (p + q) N = l. 
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As a result, we can easily calculate the average displacement 

(S) = (R)-(N-{R))=2{R)-N 

= -N + 2 — (p + q) N =N(p-q). 

The symmetric random walk can be generated by tossing a coin. One makes N attempts. To 
obtain the statistical average one has to make M»l runs. This set forms a statistical ensemble, 
the average being 

i M 

m=l 

In general case the way is more difficult, one needs a random number generator. 
One can also obtain 

{r2)= {%) (p+v) n =( n p) 2 + n p<i 



to obtain 
Thus 



(S 2 ) = 4(R 2 } - 4N(R) + N 2 =N 2 (p-q) 2 + ANpq. 



((AS) 2 ) = (S 2 )-(S) 2 = 4Npq -> = N (for p = q = 1/2) . 

For very large N the Bernoulli distribution P N (R) = (N\/R\(N - R)\)p R (l - p) N ~ R can be ap- 
proximated by the Gaussian distribution. Using the Stirling's formula for n\ we obtain 

1 



Pn{R) = - e -{R-NpY/2N Pq 



Since R = (N + S) /2 we have 



Here 



p„(S) = 1 p -[S-N(2p-l)] 2 /SNp(l-p) = 1 e -(S-S) 2 /2a 2 

" K ' ^MNp~q~ ^2no 
S = N(p-q)=N(2p-l), a=^((AS) 2 )=4Np(l-p). 



If the number of steps is very large then we can think that each step is very small and come to 
continuous description. Assuming x = Sa and regarding the time step t = Nx. Then we obtain 
for the symmetric case the probability distribution 

P(x, t) = X l^e-^ 2a2 < = -L= e-*!** , D ee £ . 
v ' V 2na 2 t y/4nDt 2x 
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Figure 9.2: P(x : t) as a function of x at Dt = 1 and 3. 



2 3 



This function is shown in Fig. !9.2I We immediately obtain 

/oo 
P(x,t) = l, (x)=0, (x 2 ) = 2Dt. 
-oo 

The above expressions can be easily generalized for multidimensional space keeping in mind 
that the probability is multiplicative. For 3D case we obtain, 

P(r t) = - e" 2 / 40 ' D = — 

We have 

(xi(t)xj(t)) = 2&ijD\t\ , (r 2 ) = 3(x 2 ) = 6DT . 

Now we can map the above results on the results on Brownian motion obtained in Sec. 18.31 by 
the Langevin method. Indeed, we can assume that during the time < X~ l between collisions the 
displacement is a ~ v/X. Thus, 

D=(v 2 )X~a 2 A- 

9.1.1 Relation to diffusion 

Consider a drop of colored dye in the water. The concentration of dye obeys the continuity 
equation, 

dC 

^ + divj = 

dt 

where J is the current of colored particles. It is driven by gradients, J = — DgradC. In this way 
we get the diffusion equation 

dC , 

^--DV 2 C = 0. (9.2) 
at 

Let us consider the initial condition 

C(r,0) =iVS(r). 
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Here N is the total number of particles in the drop. The solution with the above initial condition 
can be easily obtained by the Fourier method. Since 



C(r,0 = J ^^c(k,t)e ik - r , and c(k,t) = Ne' *' 



we obtain 

C(r A _ f N dk -Dk 2 t+ik-r _ N -r 2 /4Dt 

To derive this formula it is convenient to use spherical coordinates and to direct the polar axis 
along r. The integral over the angles is 

/ sinGJG / d$e- krcosQ = 2ii-2 / dfi cos kr M = 4n^- . 
Jo Jo Jo kr 

Then, 

£ r^dk^e-^ = - \^ e~^. 
8tc 3 Jo kr (AnDt) 3 / 2 

The relation between diffusion and random walk has been realized by A. Einstein in 1905. 
His reasoning is like that. 

Consider a thin layer between x and x + Ax. Let the number of particles in this layer at time 
t will be denoted as N(x, t) . If we introduce the probability P(a, x) Aa, to move a distance falling 
within a small interval between a and a + Aa during a short time interval x, we can write 

AN(x,t + x) = P(a,x) Aa AN(x - a) . 

Since C = AN /Ax we get an integral equation: 

daP(a,x)C(x-a,t). (9.3) 

-oo 

Since a and x are small one can expand the l.h.s. in powers of x, while the r.h.s. in powers of a. 
Using the equalities 

J ' daP(a,x) = 1 , J daaP(a,x) = (we assume symmetric distribution) 



and the definition 



— f daa 2 P{a,x) = (x 2 (x))/2x = D, 



we arrive at the same ID diffusion equation as for the Brownian motion (with correct coeffi- 
cients). 



9.2. RANDOM PULSES AND SHOT NOISE 
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Figure 9.3: On the random pulse process. 

t 

9.2 Random pulses and shot noise 

Random pulses, or pulsed random processes are encountered very often. In the simplest case the 
pulses have the same shape, and the only random quantity is the instant at which a pulse starts, 
Fig. 19.31 One well known example is the current in the anode circuit of the thermionic tube. Each 
electron escapes the cathode and moves in the space charge region toward the anode producing 
anode current i(t), 

J dti(t) = e . 

There are many examples of this type of process, e. g. impacts of the gas molecules on the wall 
of the container. Let us denote the number of pulse as k, being its starting time. Then the 
random quantity can be expressed as 

k 

It is usually assume that 

1. The random quantities and a& are statistically independent for different k, and their 
distribution functions are ^-independent. 

2. The probability of the time being in the range between t and t + dt is constant and equal 
to vdt. 

Below we shall use the above example to introduce the important concept - characteristic function 
of the random quantity. For a quantity x it is defined as 

/oo 
dxp(x)e iux . 
-oo 

Here p(x) is the probability distribution for x while the average is performed over realizations of 
the random process. For our case 

f f 1 f-/ 2 

§x k (u) = / <iaw a (a) < — / dt exp[iuF(t -t k ;a)] 
J yt m J- tm /2 

Here w a (a) is the distribution of the parameters a, while t m is the measuring time interval. If n 
pulses took place during the time t m we obtain 

§ x {u\n) = % k (u)} n 
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which then must be averaged over the Poisson distribution, 



Since 



ii" _- 

P n = —e n , n = vt m . 



e -n^ [»M")] n = exp{n[^( M ) - 1]} = «p{Vfc[M«) - 1]} 



n 



i! 

we obtain for the well separated pulses 



§ x (u) = exp J daw a (a) J dt [exp(iuF(t,a)) — 1] 



Having the characteristic function we can calculate any moment of x: 

diu 



x) = ( %^ ) =v / Jaw a (a) / <frF(t,a), (9.4) 



((5*) 2 > = (x 2 ) - (x) 2 = ( a ^2 M) ) o = v / Jaw a(a) /" > ^ 9 - 5 ) 

(&c(fi)8x(0)) =v fdaw a (a) ! dtF(t;a)F(t +h;a) . (9.6) 
The noise is conventionally measured as doubled Fourier component of the correlation function 



(I9T6I) . We obtain (check!): 

5,((o) = 2v y daw a (a) |F(co;a)| 2 . 

Since F(0, a) = q where q is the charge of the particle, we get a very universal formula 

S x (0) = 2q 2 v -> 2eJ 
where / is the electric current in the case of thermionic tube (Schottky, 1918). 

9.3 Markov processes 

Many stochastic processes belong to the class of Markov, or Markovian processes. To introduce 
a definition let us consider a random function of time, x(t) which is known at n instants t\ < 
ti< ... <t n . Let the time intervals be much greater than the microscopic time scale. We can 
characterize the random process by the probability 

w n {x\ ,ti;x2,t2',---',Xn,t n )dxi--- dx n 

that the random quantity at U lies within the range (xi,Xi + dxi). We can now relate w n to w n -\ 
by the conditional probability P n (x n , t n \x\ , t\ ; ?2! • • • ; x n - 1 , ? n - 1 ) a s 

w n (xi,h;x2,t2',---',x n ,t n ) = w n -i(x\,ty,X2,t2;...;x n -i,t n -i) 

X P n (x n , t n \x\ , t\ , X2 ) ?2 5 ■ • ■ 5 -^n— 1 5 ^n— 1 ) • 



9.4. DISCRETE MARKOV PROCESSES. MASTER EQUATION 



117 



The process is called the Markov one if the conditional probability depends only on the value 
x n -\ at the last instant t n -\ which precedes t n , 

Pn {Xni hi \%1 7 1\ ,X2j tj_, . . . ,X n — \ , t n — \ ) = P2 (Xn , tn \Xfi— 1 , tn— 1 ) = P(x ni t n \x n — \ , t n — \ ) . (9.7) 

It means that the system forgets all but the last previous values of the random process. Both 
random walks and pulse processes are the Markov ones. 

Let us consider a Markov process where the random variable t,(t) acquires discrete value 
{xk}. Then the conditional probability can be uncoupled as 

P(x k ,t\x h t ) = J^P(x k ,t\xj,8)P(xj,&\xi,t ) , to < 9 <t . (9.8) 

This is the Markov equation. For a homogeneous random quantity ^(t) depending in discrete 
times t„ the above equation acquires the form 

P(xk\n — Z,0) = ^P(xk\xj,n — m)P(xj\m — /,x ( ) , l<m<n. (9.9) 
i 



9.4 Discrete Markov processes. Master equation 

There is an important class of the processes where the random quantity acquires only discrete 
values Xi,(i = 1,2, ...,N). An example is the random telegraph noise produced by a defect 
hopping between two states in the lattice, see Fig. 19.41 




Time 



Figure 9.4: Random 
telegraph noise in the 
defect position. 



In the discrete case one can introduce the probability wi to find the system in the z-th state, as 
well as transition probability p%. For two-state system we can denote, w\ = w, pn = p, pi\ = q. 
Since W2 = 1 — wi = 1 — wwe can write the master equation for the probabilities in the form 

— = - pw + q (\- w ). (9.10) 
dt 

The stationary solution of this equation is 
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Consequently, 



qx x +px 2 . 2 \ w(*2-*l) 2 



P • </ ' [p ■ </)- 

We can also obtain the correlation function (dx(t)dx(O)) . To calculate the correlation function 
one has to find conditional probability, P{x,t\x\,ti). Obviously, at t > t\ it has the form 

P(x, t \x\, h) = w(x) + [5(jc - xi) - w(x)]g(t, h) 

where w(x) is the stationary probability to find the system in the state x, while g(t,h) is the 
probability that the state remains unchanged during the time between t\ and t > t\ . The quantity 
g(t,t\) satisfies Eq. (19.101) with the initial condition 

g(*,?i)| f=<1+0 = l. (9.11) 

The physical meaning of g(t , t\ ) is the probability It is natural to look for a non-stationary solution 
in the form 

g(t,t 1 )=g e- X ^. 

Substituting that into the master equation (|9.10l) we get X = p + q, and from the initial condition 

dBgo = i. 

g(t,ti) = e-(P + ^ t -^. 
Since at t — t\ 3> (p + q)~ l we have (x(t)x(ti)) = (x) 2 ,or ((ox) 2 ) = 0, we obtain 

(bx(t)dx(O)) = ((5*)V (p+9)kl = Pg/ Xl -^) 2 e -(P+g)M, 



Consequently the noise (doubled Fourier transform) is 

2 2pq 1 p + q 



S(a>) = (x\ — X2) 



(p + q) 2 %{p + q) 2 + & 2 
Thus noise spectrum is a Lorenzian. The integral noise is 

2pq 



duS(u) = (xi -xi) 2 -^— = 2((5*) 2 > . 



(p + q) : 

Let us for simplicity assume that p = q = X/2, than 

(xi-x 2 ) 2 A, 



S((o) 



2% I 2 + (0 2 



In many random systems the fluctuation are induced by structural defects with different transition 
rates X. Usually logarithm of X is distributed almost uniformly in a wide region between Amin 
and A max , and for realistic values of co the inequalities 

A.max « <» « A"in (9.12) 



9.5. CONTINUOUS MARKOV PROCESSES. FOKKER-PLANCK EQUATION 



119 



hold. Then the distribution of X is 

W(k) dl= r j~Y^ L = M^maxAmin) • (9.13) 

Here n c i is the density of the defects. An example leading to the distribution (19.131) is so-called 
tunneling defects formed by an atom which can tunnel between two adjacent states in the mate- 
rial. Since logarithm the tunneling probability is proportional to the tunneling distance and the 
latter is uniformly distributed we arrive at the distribution (|9.13l) . 
Averaging the noise over the distribution (|9.13l) we get 

2L CO 

provided oo satisfies inequalities (19.121) . Noise with the spectrum (19.141) is usually observed at 
low-frequencies, it is called the flicker noise. Crossovers from random telegraph noise and flicker 
noise were observed in point contacts between metals. 

9.5 Continuous Markov processes. Fokker-Planck equation 

Let us return to the problem of random walks and note that Eq. (19.31) can be reformulated for 
probabilities. We get 

P(x,t\x ,t ) = J dyP(x,t\y,8)P(y,Q\x ,t ), t <Q<t. (9.15) 

This is the Smoluchowski equation. The instant can be arbitrary, so let us make it close to t. 
Namely, let us put = t — x and then tend x to zero. We get 

P(x,t\x ,t ) = J dyP(x,t\y,t-x)P(y,t-x\xo,t Q ). (9.16) 

Now let us multiply this equation by some arbitrary function q(x) which has the properties 

q(x) — > 0, q — > at x — > ±°° 
and then integrate over x. We get 

/oo poo poo 

dxq(x)P(x,t\xo,to) = / dyP(y,t — t\xq, to) / dxq(x)P(x,t\y,t — x) 
-oo J — oo J — oo 

/oo poo 
dyP(y,t — %\xo,to) / dxq(x)P(x 1 t\y 1 t — x) 
-oo J — oo 



Since 



/oo 
dxP(x,t\y,t-%) = 1 
-oo 
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we can replace in this integral y — > x move it into l.h.s. Then we notice that 



- [P(x,t\x ,to)-P(x,t-x\x ,to)] « V ' ' ' 

X oX 



As a result, we have 

dP(x,t\xo,to) 



dxq(x) 



dx 



dyP(y,t\x ,t ) 



Here 



A(y,0 



lim^ = limi 

t=0 X x=0 X 

lim «£zZ)!> =lim I 

x=0 X t=0 X 



q'(y)A(y,t) + q"(y) B ^- + ^ 



dx (x — y)P(x, t\y,t — x), 
dx (x - y) 2 P(x, t\y,t — x) 



(9.17) 

(9.18) 
(9.19) 



Now we replace y — > x in the r.h.s. of Eq. (|9.17l) and make integration by parts. Since <?(±°°) 
</(±°o) = and q(x) is arbitrary we finally obtain 



dP{x,t\xQ,tn) 3 w . „. , . 1 3 2 „. . „. . 
a ^ = -^A{x,t)P{x,t\xQ,to) + -^B(x,t)P(x,t\xo,to) . 



(9.20) 



This equation was derived in several contexts, so it has different names: Einstein-Fokker equa- 
tion, Fokker-Planck equation, 2nd Kolmogorov equation. The diffusion equation (19.21) is a special 
case with constant A and B. 

The solution of Eq. (19.201) must be non-negative and satisfy the initial condition 



P(x, fo|*o,fo) = 8(x—xq) 



(9.21) 



The physical interpretation of Eq. (19.201) is the following. Let a stream (ensemble) of parti- 
cles emerge form the point xq at time to. Assume that they move independently. Then their 
concentration at the point x at time t is just P(x,t\xo,to)- The the flow (mass current) S con- 
sists of the "convection" part AP, where A is the convection velocity, and of the diffusion part 
— (1/2) (dBP/dx) where B/2 has a meaning of the diffusion coefficient, 



S=AP 



1 dBP 



2 dx 



(9.22) 



We see that Eq. (19.201) is equivalent to the particle conservation, 

dP dS 



dt dx 



Equation (|9.22l) is conventionally written as 

dB 



dx 



P(x,t\xo,to) - 



BdP(x,t\x ,t ) 
2 dx 



(9.23) 



The combination A — dB/dx is called the drift velocity while B/2 is the diffusion constant. 
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9.6 Fluctuations in a vacuum-tube generator 

Consider a simplest generator of electric oscillations based on 3-electrode vacuum tube, see 
Fig. 19.51 the notations are clear from the picture. 




Figure 9.5: On the vacuum tube generator. 



sion 



The tube acts as an amplifier, and the nonstationary part of the current is given by the expres- 

V 2 



la = SVA 1 



2V 2 



where Vq is the DC anode voltage. The transformer facilitates feedback, such that 



V g = MI' 



(9.24) 



(9.25) 



where M is the mutual inductance while prime means here the time derivative. Since the charge 
at the capacitor C is just 

Q = J'dt'ila-I), 

we have the following equation for the current through inductor L, 



LI' + RI = C~ l J* dt'[I a {t')-I{t' 

„ R .. 1 SM , ( M 2 (I') 2 \ 

I" + -I" + — / = /' 1 v- . 

L LC LC V 3V 2 J 



(9.26) 
(9.27) 



Now,it is convenient to introduce dimensionless variables, 

x = (Dot, I = 2Vo/(DqM, x = //To, (OqMS = /j, (Dq(MS-RC) = p, 
where (Oq = (LC)~ l is the eigenfrequency of the circuit. Then Eq. (19.271) can be rewritten as 

x + x = /jx( p--x 2 J . (9.28) 
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Let us consider the situation when the feedback parameter /j is small and use the so-called method 
of slow perturbations. Namely, the solution of Eq. (19.281) at /u = is 

jc = rcos(x + (p), (9.29) 

and we will search the general solution in the form 

x = r(x) cosw(x) , w(x) = x + <p(t) , (9.30) 

assuming the both r(x) and (p(x) are "slow" functions. What does it mean will be clear a bit later. 
Then 

x = rcosw — nisinw, 

d , * _ 9 

x = — (rcosw — rwsinwl ~ — rusmu — 2rusmu — ru cosw. 
Jx 

Here we neglected r since /j 1 . Now, 

w = l+(j), ii 2 ^ 1 -h 2cp, w^O. 

Then the l.h.s. of Eq. (19T281) is 

— 2r sin w — 2rcp cos w . 

Since the r.h.s. of this equation is proportional to /u we have to substitute the derivatives up to the 
lowest order, as x = — rsinw to get 

( 4 t\ 2 r 2 

xil — -x J = — prsinu+ —r sin m = — — r )sini< — — sin3w. 

As a result we get, 

2 ^ 

— 2rasini/ — 2r(j)cosa = — pr(p — r ) sinw — p— sin3w. (9.31) 

Now we can average this equation over "rapid motion". Namely, we multiply these equation by 
sinw(x) or by cosw(x) and then integrate over x from to 2% assuming cp(x) = const. From such 
a procedure we get 

r=\r{p-r 2 ), (j> = 0. (9.32) 

So up to our approximation, cp is constant. In Fig. 19.61 the function r(p — r 2 ) is plotted for 
p = — 1 , 0, 1 . In is clear that at p < there is only one stable point, r = 0. It can be shown that at 
p > the only stable point r = yfp. 

Now we are prepared to write down the Fokker-Planck equation for conditional probability 
i , (r,(p,x|ro,cpo,Xo). In general, when we have several variables, the conditional probability can 
be expressed as a function of vectors x = {x a } and xo = {xo«}. I n a straightforward way we get 
vector A and tensor B as 



9.6. FLUCTUATIONS IN A VACUUM-TUBE GENERATOR 



123 



0.6 












0.4 
0.2 




1 











\ 1T2~~— - 


-J5;4 0.6 


0.8 


V 1.2 


1.4 


-0.2 




\^ 








-0.4 


-1 










-0.6 













Figure 9.6: On the sta- 
tionary points. The 
function r(p — r 2 ) vs. r 
is plotted. 



(x — v\ 1 r°° 

A(y,t) = lim^— — = lim- / (<fr) (x -y)P(x,t\y,t - x) . 
t=0 X x=0 X J-oo 



%,?) = lim 

1=0 



((xi-yi)(x k -y k )) 



1 /'°° 

= lim-/ (^)(^-y ; -)(jc fc -y fc )/ 5 (x,?|y,?-x). 

T=0 X J-oo 



The Fokker-Planck equation acquires the form 
3P(x,?|x ,?o) 



i a 2 

= -divA(x,j)P(x,j|x ,*o) + -^ g^- g^(x,O f ( x ^i x o^o) • 



Below we shall use a simple model of isotropic random forces with 



In our case, 



and we get 



B rr — r B(nm — fiB B r( n — 



A r = r= -r(p-r 2 ), A 9 = 0, 



_j3P _ //3[r(p-r 2 )P] 5 
^ ¥~~2 d> + 2 



dr\drr) r 2 d<p 2 



It should be solved with the initial conditions 

P(r, (p, f |r , <po, to) = 8(r - r )5((p - <p ) 



(9.33) 



(9.34) 



(9.35) 



(9.36) 
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Let us start from the stationary distribution 

w(r,<p) = lim P(r,q>,t\r Q ,q ,t ) 

t— 50 — >°o 

for which the l.h.s. of previous equation is zero. If cp is chosen in the interval (0, 2ii) all the 
values of cp are equal, and the solution is op-independent. Then the equation (19.361) acquires the 
form 

-t— ( rip — r 2 )w — Br— — ) = or rip — r 2 )w — Br—— = const. (9.37) 
2 or \ clr r J dr r 

The only solution which is regular at r = implies that the constant is equal to 0, and 



wyr) oc rexp 



1 

BJo 



pdp(p-p : 



Crexp — 



(9.38) 



The proportionality coefficient is given by the normalization condition. Since w is cp-independent 

( P -r 2 r 



C 



2% J rdr exp y- 



45 



Here 



erfx 



i?' 2 VB 



e dt. 



1+erf 



2VB 



Tl JO 



The profile w(r) has a maximum at 



(9.39) 



y/p(l+B/2p 2 ) for p> 2V5 



for p<-2 v / fi. 



The function w(r) is plotted in Fig. 19.71 
At negative x, 



erf(-jc) = -1 + 



One can also neglect r 4 in the exponent of Eq. (19.381 Then we obtain 

w(r, (p) drda? = \n e -r 2 \ P \/2B rdr ; ( r 2) =2 5|p 



5 



271 



(9.40) 



which is called the Rayleigh distribution. 

If the generator is strongly excited, p ^> 2y / fi, we can put r = y/p + p and neglect p 2 in 
Eq. (19.381) . Then we obtain, 



w(r,<p)drd<p= JZ e ~^ B dp^, (p 2 } =B/2p: 



(9.41) 



i.e. the Gaussian distribution. 
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To find the generation spectrum let us consider the case of large amplitudes, 



r m = yfp^ \J(P 2 ) = VB/2p. 
In this case we can linearize the dynamic equations (19.321) with respect to p = r — y/p to get 

p = -pp, cp = 0. (9.42) 
The simplified Fokker-Planck equation acquires the form 

_ x dP dpP B fd 2 P ld 2 P s 



+ 



P dt P dp ' 2 \dp 2 ' pdy 2 



+ 



(9.43) 



This equation we can analyze for arbitrary initial conditions. Denoting i 3 (p,(|),?|po,(|)o,*o) = 
P(p,§\po,§oJ — to) we immediately get that fluctuations of p and cp are statistically-independent, 



P(p,(p|po,<po,*-*o) =Pp(p\poJ-t )P< 9 (<p\<poJ-to). 
The fluctuations in the amplitude are Gaussian, 



P p (p|po,f-fo) 



1 



-(p-p) 2 /2a 2 



with 



P = Poe 



-fip(t-t ) 



2no 

B 

2p 



l-e 



-2w(t-to) 



(9.44) 
(9.45) 
(9.46) 



The p(t) is just the dependence due to mechanical equations of motion (19.321) linearized near 
r = y/p. The solution for Pq,(cp|(po,? — to) has the form 



P«p(<p|<Po,f-fo) 



1 
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l+2£ 



3 -n 2 (S/2p) iU (?-f () ) 



cosn(cp — (po) 



(9.47) 
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Ast — tQ increases, the average deviation from the stationary solution, p, decays while dispersion 
o grows. One can easily check that the t — to the system tends to stationary distributions. At 
t = to + it gives proper initial conditions since 

oo 

1 + £ cosn((p-(po) = 27l8(cp — cp ) • 

n=\ 

Having the conditional probabilities (19.461) and (19.471) one can find all necessary correlation func- 
tions. Indeed, the joint probability, w(p T , p,x, to find the values p and p T after time delay x is 



w(Pt,P,x) 

w((p T ,(p,x) 



w(P)^(Pt|P,x) 



w((p)P((p T |(p,x) 



1 



2tCOooO- 



exp 



(Px-Pt 



1 

4tc 2 



1+2 £ 

n-\ 



2o2 

-n 2 D% , 



2o x 2 

e cosn((p x — cp) 



(9.48) 
(9.49) 



Here 



-piji 



B 



pt = pe 

using these equations let us calculate the correlation function 

^ z =(x(0)x(x)). (9.50) 
Lets us for brevity denote x(0) = x, x(l) = x x . Since 

*(0 = [v^+P(0]cos[t + q>(0] 

and (x(t)) = due to the facts that (p)=0, p and cp are statistically independent at any time, and 
the phase distribution is uniform. Hence (coscp) = (sin op) = 0. As a result, 



¥t = (( v ^+p)( v ^+px))(cos(/' + (p)cos(? + x + (p t )) 

= ^(p+(ppt))[(cos(x + (p T -(p)) + (cos(2/' + x + (p T + (p))] . 



(9.51) 



(9.52) 



Then, from Eq. (|9.48l) we get, 

(PPt) = y^pT^PPxpw(px,p,x) =De~ Pfi W. 

Since the joint probability w((p T ,(p,x), Eq. (|9.49l) is an even function of cp t — (p one can easily 
show that 

(cos((p x + (p)) = (sin((p T ±(p)) =0. 
As a result, (cos(x + cp T — cp)) = (cos(cp T — cp)) cosx. Then, 



I r2K rlTZ 

(cos(cp T -(p)) = ^ J d ^J Q ^9cos(cp x -(p) 



l + 2£e-" 2D ^cos«((p x -(p) 



n=\ 



(9.53) 
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Collecting all the factors we finally obtain: 

\|/ T = I (p + De-wM) e - D "M cost. 



(9.54) 



The first factor in given by the fluctuations in the amplitude while the second is due to the phase 
fluctuations. The oscillation spectrum is given by Fourier transform of the above function. In the 
dimensional variables, x — > cOqT, we get 



with 



Here 



\|/co = 4>(co - COo) + ^(g) + too) ~ - COo) 
<D D <D + h 



<D(cc) 



2% 



+ 



a 2 + 'D 2 h a 2 + ('D + h) 2 



(9.55) 



are dimensional phase diffusion constant and increment. That means a superposition of a narrow 
line with the half- width (D with a broad line with the half-width (D + h. 
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Chapter 10 
Non-Ideal Gases 



10.1 Deviation of gases from the ideal state 



We start from the case of a weakly non-ideal gas where the only pair interaction is important. 
The simplest case is the monoatomic gas where the interaction potential depends only on the 
distance between the atoms. Since 

pl 



we can write the free energy as 

F = Fa + Fi, 
Fi = -riog 



-pv(?) 



Y\dV a 



Here F ld is the free energy of the ideal gas. The factor V~ N in the argument of the logarithm is 
just because for the ideal gas the integral over the volume is V N . It is convenient to rewrite the 
above expression in the form 



F = ^ d -riog 



1+ wJ-J^ mq) - 1 ) dVl - dVN 



Now let us make use of the assumption that the gas is rarefied and only two atoms can collide at 
the same time. Then the integrand is not small only if some two atoms are close together. Such 
a pair can be extracted in N(N — l)/2 ways. Thus the integral can be expresses as 



n(n— r 

2V N 



-mi 



1 



) dVi...dV N 



N 2 

2y2 



-pv. 



12 -l) dVi dV 2 . 



Here V12 is the pair interaction potential. Since log(l +x) x at x <ti 1 and the gas density N/V 
is assumed to be small, 



TN 
2V2 
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Since the interaction depends only on the distance between the atoms we can integrate out the 
center of mass and get V. In this way we are left with the expression 



V 



B(T), B{T)= l -j (\-e-^)dV, 



where dV stands for relative coordinates. Since P = —dF /dV we obtain the following correction 
to the equation of state, 



nt 

~V~ 



N 

1 + -B(T) 
V 



The corrections to other thermodynamic potentials can be found using the principle of small 
increments. For example, G ; = NBP. 

A typical dependence of the interaction potential energy is shown in Fig. 1 10. 1 1 



2r„ 



1 1.2 1.4 T.6 



1.8 



Figure 10.1: A typical dependence of the nor- 
malized potential energy V /Vo versus the nor- 
malized interatomic distance t/tq. 



Expansion in powers of density 

In principle, the equation of state can be expressed in the form of expansion in the density, 

where coefficients B n (T) are called the virial coefficients. To determine them it is convenient to 
use the Landau fee energy, Q. = —PV, 




For the Af-particle Hamiltonians we have, 
where in general 

V m t^Vu + Vu + V 23 . 
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If one denotes 



r 3 - Pp 2/2» = ( 

^-{innyj p V 



the expression for Q. can be written as 



& = -pv = -riog 



mT 
M 2 



1+ ^ V+ hj e dVldVl + 3T / gH3V ' 23 JVl Jy 2^ 3 + 



3/2 



Again, we can integrate out the center-of-mass motion to get 



a = -py = -riog 



1 + ty + ^ | dV 2 + ^j dV 2 dV 3 + ... 



We arrive at the expansion in powers of £ 



W=l 



with 



Jl = 1 , 7 2 = J (V pVl2 - l) rfV 2 



^3 = 



-PVi: 



The structure of the integrals J n is clear, they are not small only if n particles are close together. 
To obtain equation of state one has to relate the parameter £ to the density. Since 



N 



) T.V 



V, I) 



r.v 



we have 



N 



= 1 



The set of equations P(Q and N(Q defines the equation of state. 



Spatial correlation of density fluctuations 

Let us denote n(r) the fluctuating number density, ndV being the particle number in the element 
dV. The correlation in the positions of the particles can be characterized by the average 

(An(ri)An(r 2 )) = n(ri)n(r 2 ) -n 2 . 
For a uniform system it can depend only on the difference r = \r\ — r 2 |, it must decay at r — > °°. 
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The product (n(ri)n(r2)) can be expressed through the probability density w\2 to find the 
particle 2 at the distance r from the particle one. Since the total probability of such event is 
nw 12 (r) dV2 we might write 

(n(ri)n(r 2 )) = n 2 wi 2 . 

That would be a mistake because it ignores the fact that if the points 1 and 2 coincide, the particle 
belongs both to dV\ and rfV 2 . Thus the correct formula is 

G(ri -r 2 ) = (n(ri)n(r 2 )) = n 2 wn + nd(ri - r 2 ) . 

In a similar way, 

(An(ri)An(r 2 )) = fiv(r) + n5(r l -r 2 ) , v(r) = n[wi 2 (r) - 1] . 

The quantities (An(ri) An(r 2 )) and v(r) are called the correlation functions. Integrating the 
previous equation with respect to dV\ <iV 2 over a volume V we have to recover ((AN) 2 ). From 
the formula above we find the normalization condition, 



/ 



vdv = m^_ l = _TN(B_V) _ x 
N V 2 \dPj T 



This is zero for an ideal gas, only interaction leading to a finite compressibility leads to a corre- 
lation. Since for the pair interaction 

y(r)=n(e-^ lir] - 1 

we get 



J 2 = J (e-Wn(r) _^ dv= Y_J V ( r ) d 



3 r. 



We see that the correlation function is an important property. 

It can be directly determined from the experiments on the light scattering. Consider a wave 

F(R) =F e lkR - im 

which is scattered by the particles residing at points r, (see Fig. 110.21) . Let the scattering ampli- 




d Detector Figure 10.2: On the scattering problem. 



tude / be the same for all the particles. Then the scattered wave at the detection point r is 

N ikpi N ikpi 

F, c (r) = /£ F(r,) = fF £ e^~^ . 



10.1. DEVIATION OF GASES FROM THE IDEAL STATE 



133 



Here p, = |R — r,-| is the distance between the scatterer and the detector. We have p, = i? — V[ cos (|) 
where (|) is the angle between r ; and R Now let us take into account the fact that the detector is 
usually place far from the scattering medium, R 3> r ; . Under this approximation we can replace 
p ; by R in the denominator of the previous formula, while the phase needs more exact treatment, 

kr ; + kpi = kri + kR — kn cos <|) = kR — r,-(k — k') . 

In this way we get, 

ikR—iat 

" * « ?' - k - k '' 

Thus the ratio between the average intensity of the scattered wave and the intensity of the incident 
wave is 

N N 

\f\ 2 ^e^- r ^N\f\ 2 S(q). 
i=lj=l 

5(q) is called the structure factor. Replacing the double sum by its ensemble average, we can 
write it as 

S(q) = ^JdV 1 J dV 2 (n(r l )n(r 2 ))e i ^-^ = l + J d 3 rv(r) e^ r . 

This is the way to extract the correlation function from the experiment on light scattering. Note 
that for small scattering angles q — > the structure factor is proportional to the compressibility 
of the system. Thus one can expect singularities of the scattering cross section at the phase 
transition point. 

Van der Waals' formula 

There is an interpolation formula which allows to follow the phase transition between gaseous 
and liquid state. To derive such a formula let us assume that the interaction is small in a sense 
that Vq <^ T. To perform the integration for the virial coefficient let us assume that at r < 2ro we 
have Vn > T.The quantity 2ro has a meaning of the atomic diameter. Let us split the integral for 
B(T) into 2 parts, 

B(T) = 2n ' {\-e-^)r 2 dr + 2n jf (l ? dr . 

In the first integral we neglect the exponential and obtain for that b = 1671^/3. In the second 
integral we expand the exponential to get 

p oo 

-271(3/ \V l2 \r 2 dr = -2^a. 

J2r Q 

In this way, 



B(T)=b-a/T -> Fi = N 2 (bT-a)/V, Gi=NP(b-a/T). 
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The total free energy is 

F = Nf(T) -NT \og(e/N) - AT (log V -Nb/V) -N 2 a/V. 
Now we do something approximate. Since we have assumed that the gas is rarefied, 

V>M> -> logV -Nb/V &\og(V- Nb). 
Let us assume that this expression holds also for large density! As a result, 

Ft = -NT log(l — Nb/V) -N 2 a/V. 
This formula take account of the finite compressibility at large density. Now we get 
dF NT N 2 a ( N 2 a\ , 

This the van der Waals' equation. 



Chapter 11 
Phase Equilibrium 



11.1 Conditions for phase equilibrium 

Consider an isolated body with the energy E and volume V. This state is non necessary ho- 
mogeneous, it can consist of two (or more) phase. For the case of two phases, the equilibrium 
conditions are 

T\ = T 2 , P\=Pi, vi=V2- 
Since the temperature and pressure remain constant, the equality 

correspond to a line in the (P, T)-plane along which the phases coyexist. In the (T, V)-plane, 
there are 2 lines because at a given pressure and temperature can have different volumes. This is 
illustrated in Fig. 111.11 




Figure 11.1: The hatched area cor- 
responds to a mixture of 2 phases. 



The Clapeyron-Clausius formula 

Differentiating the equilibrium condition /j\ = ^ with respect to temperature we get 

d/Ji dpi dP d/J2 dP 
df + Wdf ~ W + ~dPdf' 
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Since 




(s = S/N, v = V/N) 



we obtain 

dP s\—S2 q 
dT vi — V2 y(vi — V2) 

where g = r(^i — 52) is the heat of transition. This the Clapeyron-Clausius formula. This equa- 
tion gives the temperature dependence of pressure along the phase equilibrium curve. Written 
as 

dT _ T(v\ — V2) 
dP ~ q 

it gives the change in the equilibrium temperature (freezing point, or boiling point) when the 
pressure changes. 

The law of corresponding states 

Let us discuss as an example the van der Waals equation of state, 

_ NT N 2 a 
~ V-Nb~l^' 

We can notice that there is a special temperature, T c , at which the isotherm has an inflection point. 
We have: 

fdP\ fd 2 P\ 8 a la 

Measuring the P, V, and T in the units P c , V c and T c , respectively, we can rewrite the equation of 
state in the form 

( p '+ya) (3v , -i) = sr / . 

The van der Waals' isotherms determined by this equation are shown in Fig. 111.21 So we are 
able to express the equation of state in a form which is independent of the particular properties 
of the gas. We observe that at T < T c there are regions with positive dP/dV. In that regions the 
system cannot be stable. On the other hand, we know that the equilibrium can be achieved only 
at P = const. As a result we arrive at the situation shown in Fig. lll.3l To the right from the point 
e the system is in a gas state, while to the left from the pint b it is in a liquid state. The phase 
equilibrium takes place along the straight line b — e which corresponds to P = const. This line 
must be constructed in a way to keep /ji = ^2. This difference can be expressed as an integral 
along the transition path, 

He-Vb= [ d/j = 0. 
Jb 
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Figure 11.2: Van der Waals' 
isotherms. The numbers near the 
curves are the ratios T/T c . 



Figure 11.3: On the gas-liquid transition. 



V 



Since d/j = (V/N) dP we come to the conclusion that the integral along the isotherm, 



Jb 



VdP = 0. 



Geometrically it means that the areas between the isotherm and the line b — e below and above 
the line must be equal. This rule is called the Maxwell construction. 

Van der Waals theory of the critical point 

The calculations can be easily performed near the critical point, T c . Introducing notations 

P = P c (l+p), T = T c (l+x) £ = ^(l+„) 

and expanding in powers of x and n up to non-trivial order we arrive at the equation of state 
p = 4x + 6xn + (3 /2)n 3 , (dp/dn) x = 6x + (9/2)n 2 . 
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The Maxwell condition can be written as 

[ e VdP = -> r n(^-\ dn = 0. 
Jb Jn h \dnj % 

Since the integrand is an odd function of n we get n e = —rib. From the condition p\ = p2 we 
obtain 

n e = — rib = p = 4-x. 

The boundary of the metastable region are given by the equation 

n c i = -n c = 2a/-x/3. 

According to the Clapeyron-Clausius formula, the heat of transition is proportional to v / ~^- 



Chapter 12 

Continuous Phase Transitions 



Introduction 

In the following set of lectures we shall discuss so-called continuous phase transitions, or transi- 
tions of the 2nd order. A generic system to discuss the transitions is a magnet. Thus we start in 
recollection of thermodynamics of a magnet. 

Thermodynamics of a magnet 

Consider a long and thin solenoid with the length L and number of windings N. Then the mag- 
netic field inside the solenoid is H = NI /L, where / is the electric current. When the magnetic 
flux 4> 

through the solenoid is changing an electro-motive force, £ = — d<&/dt, the work made by 
the battery being 

AW b = 'EI At = I A4> = NAIAB = VHAB . 

Here A is the solenoid area, V is its volume, while B = 4>/A is the magnetic induction. Introduc- 
ing magnetization M from the relationship B = hq(H + M) we can express the work per volume 
as 

AW b /V = A(/joH 2 /2) +noHAM. 

The first item is the energy of external magnetic field which is present also in the absence of 
material. The second term is the work done by the field on the material. Consequently, the work 
done by the material can be expressed through the total magnetic moment M = VM as 

AW = -HAM. 

As a result, the 1st law of thermodynamics reads as 

dU = TdS-HdM 
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F(T,M) = U ~TS -*dF = -SdT + HdM : S =- — , H 1 * 



T 



G(T,H) = F-HM -»• dF = -SdT-MdH, S=-[^] , M = - ( 



Generalizing of other thermodynamic potentials is more or less obvious: 

{dr) M > h -\dMj, 

BTj H ' \dH J T 

General considerations 

Uniaxial ferromagnet is a simplest example of phase transition. At zero external magnetic field 
magnetization vanishes at certain temperature, T c . Below T c a spontaneous magnetization Mq{T) 
is observed, its direction can be "up" and "down" with equal likelihood. The dependence Mq{T) 
is schematically shown in Fig. 112.11 This figure can be explained in the framework the Ising 

' M Q (T) 



Figure 12.1: The spontaneous magnetization as a function 
of temperature 



model. According to that model, spins are located at lattice points in a regular lattice. They can 
point up and down. Nearest neighbors interact in a way that is is favorable to point in the same 
direction. As we know, the free energy G = U — TS — HM has to be minimized. At H = it 
consists of two terms, U and —TS(T). At low temperatures the energy U is more important and 
the system is a ferromagnet. At high temperature the free energy is minimized by disordered 
state in which the entropy is large. It is the fight between the order and disorder that makes the 
critical state specifically interesting. 

In real life, the above conclusion is true for the dimension d > 2, while for d = 1 the mag- 
netization never vanishes. That indicates that phase transition is a collective effect depending on 
interaction of many spins. The higher the dimension the greater the number of neighbors, the 
stronger the collective effects. 

Coming back to the case of a uniaxial ferromagnet, we can define the spontaneous magneti- 
zation Mq(T) as the order parameter. In some cases it is difficult to specify the order parameter. 
In general it can be a scalar, a vector, a tensor, etc. 

When an order parameter is specified, the next question is if the transition is of 1st order, 
or it is continuous. In the example of the ferromagnet, it is the question if the spontaneous 
magnetization goes to zero at T — > T~ is a continuous way, or it is abrupt. This is a delicate 
issue. Assume that we ramp the external magnetic field from a negative to a positive value. Than 
the H = the magnetic moment changes from —Mq(T) to Mq(T), i. e. the transition is of the 1st 
order. Thus the character of transition cannot be specified without specifying the transition path. 
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At continuous phase transitions critical phenomena are observed. Usually a number of quan- 
tities show power law behavior close to T c , e. g. 

Mo(r)~(r c -r)P. 

Other examples of critical exponents for thermodynamic quantities are 

c~\t c -t\-«, 5C = (^) r ~l^- r r" \M{HJ = T c )\~H l l\ 

An important concept of the theory of continuous phase transitions is the universality class. 
It became clear during 1960's that a number of details in a given system are irrelevant as far as 
critical exponents are concerned. Systems of the same dimension and with a phase transition 
into an ordered state with the same symmetry belong to the same universality class. They have 
essentially the same critical properties. The justification of that concept will be discussed later. 

Examples of phase transitions 

We shall classify the phase transitions by the spatial dimensionality and the number of indepen- 
dent components of the order parameter, (d,n). 

Magnetic systems 

Uniaxial ferromagnets: described by the Ising model, the universality class being {d, 1). 

Hard axis ferromagnets: mo is a vector in the xy-plane perpendicular to the hard axis, (d, 2) . 
This model is called the isotropic xy-model, the universality class being (J, 2). 

Heisenberg model: the magnetization is isotropic in 3 dimensions, the universality class being 
(J, 3). 

So far we have assumed isotropy in spin space. This assumption can be relaxed, and one can 
also expect, say, cubic anisotropy. In this case the corners of a (hyper)cube in spin space are 
energetically favored (or suppressed). That gives rise to new universality classes. 

Antiferromagnets: Neighboring spins prefer to point to different directions, and on the average 
there are equally many spins pointing in opposite directions. The order parameter on a 3d 
cubic lattice can be chosen as staggered magnetization, 

m, = £(-l)* +/+m (nW, 

klm 

where (m^/ m ) is the magnetic moment of spin at the lattice point (k,l,m). Note that the 
universality classes for antiferromagnets are the same as for ferromagnets. 
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Fluid systems 

The universality class is the same as for the Ising model, (d, 1) because the order parameter is a 
scalar. The situation is more complex for liquid mixtures. 

Superfluids and Superconductors 

At the temperature T = m 2K, liquid He 4 undergoes a continuous phase transition from the 
normal phase (Hel) to a (partially) superfluid phase (Hell). The relative fraction of superfluid 
component, p s /p decreases continuously from 1 at T = to at T = T^. It appears that the 
proper order parameter is a two-component rotation invariant quantity, so the universality class 
in (3,2). 

A similar situation is relevant to superconductors. However, the critical region in the "old" 
superconductors is so narrow that it is almost irrelevant form the experimental point of view.^ 
The critical phenomena were, however, observed in high-r c superconductors. 

Liquid crystals 

Liquid crystals consist of long molecules. At the 1st approximation they can be considered as 
inflexible rods. The simplest phase is nematic where the rods are oriented. Otherwise the nematic 
is a disordered liquid. 

There exist more complicated structure like cholesteric phase where a director rotates at a 
constant pitch in a plane perpendicular to the direction in which one moves. The period is about 
3000 A. Smectic liquid crystals combine orientation order with a spatial one along one direction. 

Structural phase transitions 

These transitions are changes in the spatial symmetry of the crystalline lattice. 
Other phase transitions 

One can name many other phenomena which can be regarded as critical ones, e. g. change in the 
symmetry of adsorbed monolayers, percolation, dynamical phase transitions, etc. 

12.1 Landau Theory 

Landau theory was designed to describe systems close to a phase transition where the order 
parameter \\f is small. \\f can be a scalar, vector, etc. Near the transition point we can expand the 
free energy as 

G(P, r,\|f) = G + ay +A\|/ 2 + C\|/ 3 +By 4 .... 

Having in mind the magnetization as an example, we can specify magnetization M as an order 
parameter, then the free energy depends on T, H, M where H is the external magnetic field. Those 

'The situation is a bit different at low dimensions. 



12.1. LANDAU THEORY 



143 



are the intensive parameters which characterize the state. Note that G is not a true Gibbs free 
energy, it is a hypothetical free energy which would be the case if the system with the order 
parameter \\r could exist as an equilibrium one. The equilibrium is reached at the minimum of G, 
and in the minimum it coincides with the Gibbs free energy. 
The total scheme of the Landau theory is the following. 

• The free energy must be properly defined and then expanded in a Taylor series up to the 
minimal relevant order (see below). 

• The spontaneous value(s) of the order parameter is found by minimization of G with re- 
spect to \j/ keeping the thermodynamic parameters constant. 

Uniaxial ferromagnets 

In zero magnetic field there is up-down symmetry, G(T,M) = G(T, —M). Thus 



AG(T,M) = G(T,M) — G(T, 0) 



rjT) 
2! 



-AT + 



uiT] 
4! 



M 4 + - 



Existence of stable minima requires u{T) to be positive. At r(T) > the free energy has one 
stable minimum, while at r(T) < there are 2 equivalent minima ±Mq, see Fig. 112.21 The 
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Figure 12.2: The free energy above 
(left) and below (right) the critical 
temperature T c . 



M 



M 



higher symmetry phase at r > is replaced by a lower symmetry phase. This phenomenon is 
called the spontaneous symmetry breaking. At r(T) = the high symmetry of the disordered 
phase in broken and one of the low temperature ordered phases is chosen. 
Obviously, r(T c ) = 0, and near T c we can assume 



r(T) = at; u(T) = u(T c 



u . 



Here x = (T — T c )/T c is the reduced temperature variable. Differentiation of G with respect to M 
yields 



ax+-M\ 



This equation has 3 solutions, 



M = 0, M = ±M = ±^/-6ax/u 
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From Fig. I12.2l it is clear that the 1st solution represents a stable minimum above T c , while the 
other represent degenerate minima below T c . If we present the solution as 

Mo<*(-t)^ — >¥o oc (-iO' J 

we obtain (3=1/2 for the critical exponent. The critical exponents following from the Landau 
theory are called "classical". 



Jump in Specific Heat 

Now let us consider the specific heat, 



,,dS\ ^fd 2 G 

c = r k- = -t 



Here G is the usual free energy, 



*TJ H=0 \dT 2 



G(T,H) =minG(r,//,M) 

M 



H=0 



At H = we get 

G(r,0,0) ; x>0 



G(T,H 

As a result, at x < we obtain 



G{T,0,M {T)) ; x<0 ' 



,„ . ~,„ . ax6a(— x) u f 6a{— x) x ~ 

G( r,o) = G(r,o,o) + y ^ + -(^ r ' 

Now we easily obtain the specific heat by differentiation. Denoting C + = — r3 2 G(r,0,0) /dT 2 
we obtain 

r=l c + ; x>0 

{C+ + (T/T c ) 2 ■ (3a 2 /u) ; x < ■ 

Thus we observe a negative jump in the specific heat if one passes the critical point from below. 



Magnetic Susceptibility 

Now let us study a response to a small external magnetic field. Then we have 

r(T) ? u(T) a 
AG(T,M) = -HM + ^^M 2 + ^^M 4 + ■ ■ ■ . 

2! 4! 

The minimization with respect to M leads to the equation for the equilibrium value of the mag- 
netization, M e , 

H = rM e + ^M 3 e + ---. 
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The inverse susceptibility is defined as 

Substituting the equilibrium magnetization at H = we obtain 

-i _ / a% ; x > 
1 ~\ 2a(-x) ; x < ' 

If we define the critical exponent of the quantity A (x) as 

lnA(x) 

s = — lim — 

x^o+ lnx 

we find the classical critical exponent y = 1 . We get %(x) oc |x| ~ Y with the slope ratio A + /A- = 2. 
At the critical isotherm, x = 0, 

H=—Ml ->M e ocH 1/3 . 
3! e 

If we in general assume M e // 1//§ , then the classical value of 8 is 3. Later on we shall compare 
the values of critical exponents with more general theory and with experiment. 

Role of External field 

Let us now discuss the situation in a finite external field. The plot of the free energy vs. M is 
shown in Fig. U2.3l for x > (solid line) and x < (dashed line). We observe that there is a stable 




Figure 12.3: The free energy at a finite external field. 



minimum in both cases - magnetic field removed the system from its critical point. 

Conclusion: If we are interested in continuous phase transition the fields which linearly 
coupled with the order parameter must be removed. 
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Role of Cubic Invariants 

Now let us consider the case when symmetry of the system allows \j/ 3 terms. Then 

r(T) 9 c q u a 

AG = -^-\ir xir* H — \ir H — . 

2! V 3! V 4r 

Let us put c > 0. The analysis of that free energy becomes clear from Fig. 112.41 At sufficiently 
large positive x the profile has a shape shown in the left panel. It has one stable minimum at 
\\f = 0. At low temperatures an additional minimum develops, and at some X2 this minimum is 
degenerate with \\f = (middle panel). At lower temperatures the second minimum is the only 
stable one (right panel). Thus there is a (weakly)^r,st order transition from \|/ = to some \|/ = \|/q 





Figure 12.4: The free energy with a cubic invariant in- 
cluded. 




at x = %2- 

Conclusion: Cubic terms results in a first-order transition rather in a continuous one. x 
does not have the significance of the transition temperature in this case. 
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Tricriticality 

Now let us return to the simplest case where the free energy is even in the order parameter. Let 
us assume that r > 0, but u is negative. To keep the stability one has to add the higher order term 
to get 

. ~ r 2 u 4 w fi 
AG = — \ir H — \ir H — \ir • ■ • . 

2r 4r 6r 

At w > the system undergoes a 1st order phase transition at some temperature 7b corresponding 
to r = tq > 0. Above Tq the equilibrium order parameter is zero (see right panel of Fig. 112.51) . 
At T = To the transition takes place to one of a symmetric set of states with lower symmetry 
at which the order parameter is ±\|/q. The temperature dependence of the order parameter is 



Figure 12.5: The free energy with a cubic invariant in- 
cluded. 




shown in Fig. 112.61 Suppose now that u is a function of some parameter, p, and it changes sign at 
p = p c . At this point the character of phase transition will change from 1st order to continuous. 
The point r = ax = 0, u(p c ) = is called the tricritical point. It is easy to find classical critical 
exponents at the tricritical point. Putting u = and minimizing the free energy we obtain the 
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o 




Figure 12.6: The order parameter as a function of the 
temperature at u < 0. 




T 



expression for the order parameter, 





1/4 



Thus % = 1/4. 

Summary of the Landau recipe 

• Given that the system has a continuous or weakly 1 st order phase transition form a disor- 
dered phase to the phase of higher symmetry. 

• Characterize the order of the low symmetry phase and define the order parameter (scalar, 
vector, tensor, or . . .). 

• Introduce the proper free energy G(T,\\f) for a given space-independent order parameter. 
The given value of this parameter does not have to be the equilibrium value. 

• Write down the Taylor expansion of G in powers of \|/, where all the terms compatible with 
the symmetries of the system are included. Include only the minimum number of terms. 

• Write the coefficients of the \j/-expansion as a Taylor expansion in x = (T — T c )/T c and 
keep only the leading onesP 

• Determine the equilibrium value(s), V|/o, by minimizing G with respect to \\r. 

• Substitute \|/o into the minimum, free energy and calculate equilibrium properties like crit- 
ical exponents. 

2 Sometimes a parameter different from the dimensionless temperature can play a role of x. 
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Critique 

• The Landau theory assumes the existence of the phase transition. 

• A general recipe for constructing the order parameter does not exist. 

• Spatial dependence of the order parameter is ignored. 

• Fluctuations of the order parameter are neglected. 



12.2 Scaling laws 

Consider a system close to continuous phase transition. Let us introduce reduced temperature, 
x, and external field h, the transition point corresponding to (x, h) = 0. Since we are interested 
in singular behavior near the critical point let us separate the singular part of the free energy, 
G s (x 7 h). The crucial point is to assume (following B. Widom, 1965) that 

G s (X a x,X b h)=XG s (x,h). 

This is the so-called homogeneity postulate. The physical reason for the postulate will be dis- 
cussed later in connection with renormalization group arguments. The postulate allows one to 
express all the critical exponents through the constants a and b, and to find relationship between 
the exponents. These relations are called the scaling laws. 
To derive scaling laws we choose X a = | t: | 1 . Then, 



G,(T,*) = W ,/ "C.(^|,|^)- 



Since x/|x| = ±1 we can express G s as 

G s (x,h) = \x\ 2 - a <S> ± (h/\x\ A ), cc = 2-l/a, A = b/a. 
After such an assumption the specific heat is 

d 2 G,(x,0) 

C ~ :r-= ~ X 

dX 2 

while 4>±(0) =A± are constants. The generalized magnetization is 

m ^^ = | T | 2 -«-V ± (VN A ). 

oh 

At x > spontaneous magnetization mo vanishes, thus 4>' + (0) = 0. However, when x < 
& '_(0) =B ^0. As result, 

(3 = 2-a-A. 
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In a similar way, the isothermal susceptibility in zero field is given as 

x=gX~W = W^ ± (o). 

With <J>£(0) = C± ^ we obtain 

y= -2 + a + 2A. 
Excluding the "gap exponent" A we have 

A = (3 + y -> a + 2p + y=2. 

This is the first example of the scaling law. Note that classical exponents are (a = 0, |3 = 1/2, y = 
1) while the exact Ising one for a 2D system are (a = 0, [3=1/8, y = 7/4), as has been derived 
by L. Onsager. Both sets meet the scaling law. 

What is left is to determine the exponent 8 for the critical isotherm. The problem is the 
argument of the function 4>' ± tends to infinity at |x| — > for finite h. Assuming that ®'±(x) ~ x K 
for large x we obtain 

m(|x|)^0,/i)~|x| 2 - a - A - KA /i K . 
For m to have a finite value at |x| ->0we have to put 

A 

2 — a — A — kA — > 8 



2-a-A 
After a simple algebra we obtain 

A = p8 = p + y -> oc + r|(l + S)=2, 

that is the second scaling law. 

Using the scaling laws we can express the behavior of the order parameter as a law of corre- 
sponding states as 

m _ , ( h 
klP * I IxlP 8 



12.3 Landau-Ginzburg theory 

The Landau-Ginzburg (LG) theory is an attempt to take into account fluctuations of the order 
parameter in its simplest way. Taking the uniaxial ferromagnet as an example we consider now 
the local magnetization m(r) as the order parameter. Then the free energy becomes afunctional 
of m(r) rather the function of a total magnetic moment, M. The recipe is to add only simplest 
non-trivial terms. Since the free energy must be an even function of magnetization one can 
imagine the combinations like m(r) Vm(r), m V 2 m, (Vm(r)) 2 , etc. The 1st combination can be 
transferred into a surface integral, and the 2nd and the 3d ones can be combined using partial 
integration. As a result, the LG functional is constructed as 

Glg = J dr { |(Vm) 2 + r -m 2 (r) + ^m 4 (r) + •••}. 



12.3. LANDAU-GINZBURG THEORY 



151 



As before, r = ax, u > 0, g > 0. The latter inequality implies that the homogeneous state is the 
equilibrium one. 

The LG theory allows for long-range fluctuations because it is an expansion in powers of the 
magnetization gradient. 



Classical fluctuations 



In the classical liming discussed we keep only the terms quadratic in fluctuations. Then the 
fluctuations are Gaussian and various fluctuation modes are statistically independent. At T > 
T c , and with h = 0, the spontaneous magnetization (ra(r)) = 0. Consequently, m(r) is itself a 
fluctuation. To order of m 2 we have 



G LG = J dr{ 8 -(Vm) 2 + r -m 2 (r) + •••}. 



(12.1) 



Below T c the fluctuation is 8ra(r) = m(r) — mo(T) where mo(T) = (m(r)) is the spontaneous 
magnetization. The expansion up to (8m) 4 gives 



Glg = |jr{|(V5m) 2 + ^m2 



4! 



+ 



r+ 3! 



(8m) + 



2 + 4 m ° 



(8m) : 



+ ^umo (8m) 3 + (8m) 4 + • 



(12.2) 



According to the Gaussian approximation, the items proportional to (8m) 3 and (8m) 4 are ne- 
glected. Furthermore, mo = —6r/u, and the item proportional to 8m vanishes. As a result, 



Glg = / i /r^(V8m) 2 + ^) m 2 + ... 



(12.3) 



Since 



we obtain above T r 



J drA(r)B(r) = ^A k B k - / ^A_ k 5 k 



1 ' 



(12.4) 



£ ; means the we restrict summation up to some ko we have to do that because we neglect higher 
gradients. 

Now we are able to calculate correlation functions like 



X qq' 



_ jY^dm^m^m^ exp(-G LG ) 
(Wqmq ' )_ /nUm k ex P (-G iG ) 
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Here T] / k means that one has to take into account only |k| < ko. Since m(r) is real, m\ = m*_ k , it 
is clear from d 12.41) that 

where 

r™ - /™ m \ - JWk dm ktn- q m q exp(-G LG ) 
q " ( qq) " /n^m k exp(-G iG ) • 
Let us count only those k for which k x > 0. Then 



k k 

/ // 

^(gfc 2 + r) m_ k m k = 2^(gfc 2 + r) m k m k . 



k k 

As a result, we are left with the integral 

r m _ j_ / dm q dm q m q m q exp [- (g<? 2 + r)m- q m q /V] 
q V f dm-. q dm q exp[—(gq 2 + r)m- q m q /V] 

Since m_ q is a complex variable we can parameterize it as m q = me"' and calculate the Jacobian 

9(m_ q ,m q ) _ 



3(m,4>) 



2im. 



Then we can introduce a new variable jc = m 2 , = Imdm and use the result for Gauss integral. 
As a result, 

pm 1 

q gq 2 + ax ' 

This formula has been obtained previously by Ornstein and Zernike in 1914 using other consid- 
erations. After Fourier transform to real coordinates we obtain for d > 1 and r 3> £, 

rm/ n / r( 1 - rf )/ 2 e-^ for r > J > 1 - AT - 
r (r) ^{^ for r«£j>2 ; 

In this way we predict critical exponents for the correlation length, v = 1/2. 
The Ginzburg criterion 

Let us estimate the validity of the approximation made. The measure of the total strength of the 
long-wave fluctuations are given by the integral 

*r»(r) = i?, r^=r q L = (ax)- 1 . 



12.4. GINZBURG-LANDAU THEORY OF SUPERCONDUCTIVITY (SC) 



153 



Let us denote a typical value of the fluctuation squared by (8m) 2 . Since the typical diameter of 
correlated region is £ we have 

Consequently, 

Now we can estimate when we can neglect 4th order terms in the expansion in powers of fluctu- 
ations. A typical value of m when the 4th and 2nd order terms are comparable is 



r _ 2 u _ 4 _ 2 12ax 

-m = — m — > m = 

2 4! u 



The LG theory is valid at (8m) 2 <C m , or at 

x (rf-4) /2<< ^ fg_y/\ 

u \aJ 

This is the famous Ginzburg criterion. We see that at d > 4 this criterion is always satisfied 
because the r.h.s. is a constant depending on the concrete problem under consideration. Thus 
d c = 4 is called the upper critical dimensionality. Accordingly, all the critical exponents take 
their classical values. 

At d < d c = 4 the Ginzburg criterion is violated close to the critical point. For d = 3 the 
criterion has the form 

x > u 2 /sg 3 , 

so the LG theory is reasonable outside that region. The upper critical dimensionality d c = 4 is 
valid for all the universality classes (d, n). We postpone a discussion what is going on in a close 
vicinity of the critical point. 



12.4 Ginzburg-Landau theory of superconductivity (SC) 

Let us formulate the theory of SC transition as the one for a general continuous transition. First, 
one should define the order parameter. As the order parameter it is natural to chose the wave 
function of the Bose condensate, x ¥. According to the principles of SC, it is natural to assume 
that the ground state corresponds to the total momentum equal to 0, the wave function being the 
same for all the Bose particles. 

Near the critical temperature, the modulus of the order parameter is small, and one can expand 
the thermodynamic potential as 

g s = g n +a\y\ 2 + ^\y\ 4 + ---. 

Because we are interested in the vicinity of T c we can expand the coefficients in power of 
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According the definition of T c , above T c the stable state corresponds to *P = 0, while below T c 
*P 7^ 0. Thus the coefficient a should change the sign at the transition point: 

a = ocx, a > 0. 

As a result, we describe the equilibrium values of the order parameter as 



¥ = 

\*¥\ 2 = -{a/b)% 



at 
at 



T > T c , 
T <T C 



Inserting the equilibrium value if l^ol 2 into the expansion and comparing the result with the 
known relation for the critical field, we get 



Qs — Qn 



2b 



871 ' 



The last equality is a consequence of the definition of the critical field. Indeed H 2 /Sn is just 
the energy of magnetic field repelled from the sample in the MeiBner state. The ratio a 2 /2b can 
be related to the critical temperature T c from the BCS theory of superconductivity. ™ The most 
interesting case is the case of external magnetic field. In this case *F is coordinate dependent. 
Thus we should add both the energy of magnetic field H 2 /&n and the energy connected with 
the inhomogeneity. Near the critical point it is enough to add |W| . Here we come to the most 
important point: Cooper pairs are charged particles. Consequently, because of gauge invariance, 
only combination 

2e 

—ihV -\ A 

c 

is possible. To make a proper dimension we write the corresponding term as 



1 

4m 



-ffiV + y A 1 T 



Finally, we get for 8^ = Q s — Q„ 



dv ia%m 2 +-m A + 



Am 



-i»V + —A ! '1' 



+ 



8tt 



Here is the free energy of the normal state without magnetic field. To get the minimum we 
calculate variation with respect to x ¥* : 



dV \ axWdy* +bm 2 Wd x ¥* + 



1 

Am 



ihV H- —A J ^ ^ ihV + — 



3 a? /2b = cl g(£f) {ksTcY . where g(£f) is the density of states at the Fermi level while c\ is a numerical 
constant. 



^2 
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The item with the V&¥* can be integrated by parts. Using the Gauss theorem we get 

Im>* (-ihV+—A)*i>dS+— I dVSW* ( —ihV +—a\ 
Js V c J 4m J V c J 



ih 
Am 



Then we put h^* = at the surface and arbitrary inside. As a result, we get the following 
equation for the order parameter 



W .. . 2c 



-m + — a v P+ax l i / +&| v i / r v i / = o. 

Am \ c J 

If now we put &¥* at the surface to be arbitrary, we obtain the boundary condition 

n^-/W+yA^| 5 = 0. 

The variation with respect to leads to the complex conjugate expressions. 

Now it is important to get the equation for electric current. To obtain it one should calculate 
the variation with respect to the vector potential A. The variation of H 2 leads to 

8(curl A) 2 = 2curl Acurl 6A. 

Then we can use the relation 

div [a x b] = b curl a — acurl b 

to get 

8(curl A) 2 = 26Acurl curl A+2 div [8A x curl A] . 

The second integral can be transformed into the surface one, thus it is not important. On the 
other hand, from the Maxwell equations 

An 2 
curl curl A =curl H = — j — > 8(curlA) = 2j6A. 

c 

The rest of the free energy can be calculated in a straightforward way, and equating the total 
variation to zero we obtain 

j =-(fw-wi m 2 K 

2m mc 

This is just the quantum mechanical expression for the current for a particle with the charge 
(— 2e) and the mass 2m. The set 

( l/4m) [-W + (2e/c)A] 2x ¥ + ocx^ + ^l^l 2 ^ = 0, 
j = (ieh/2m) 0F*V¥ - W) - (2e 2 /mc) |¥| 2 A 

forms the Ginzburg-Landau equations. 
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Dimensionless parameters and their meaning 

To make the equations simples new dimensionless parameters are usually introduced: 

H , r ., A 



vj// 



^0 



H' 



H C V2' 



r 

8 



A' 



with 8 



2mc 2 



H c = 2V% 



ax 



arc 



The quantity *¥q is a spatially-homogeneous solution of the GL equations in the absence of 
external magnetic field. In the following we will omit primes and use these variables. As a 
result, the set of equations can be expressed as 



V-A Y-Y+l'IrY 



K 



curl curlA (Y*V»F - W) - |¥| 2 A 



0, 




with the boundary condition 



n 



-V-A \ x ¥ 



K 



surface 



0. 



This set contains only one dimensionless parameter 

-eH r 5 2 



K 



2V2- 



hc 



which is called the Ginzburg-LandauiGL) parameter. 

To understand the meaning of the parameters let us consider the simplest problem, namely 
penetration of a weak field into the superconductor x > 0. Let H || z, A || y, (see Fig. 112.71) . We 



H 



N 


S 




z 








1 \ 

\ H 




5 



Figure 12.7: On the magnetic field penetration into a super- 
conductor. Solid line is the field profile while dashed one 
shows spatial dependence of the order parameter. 



have 



H(x) 



dA y 
dx 



It is natural to consider *F as a function only of x. We get 



1 d 2y ¥ 

K 2 dx 2 



• ¥+AW| =0. 



d*¥ 

dx 



surface 



0. 
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At K <C 1 one can assume *P =const, in the bulk of material it is natural to assume l^] 2 = 1, we 
chose *P real. Immediately we get from the second GL equation 

< LA-A = -> H = H e~ x , in usual units H = H e x/8 . 
Thus 8 is just the London penetration depth near T c . 



Application of the GL theory 

Surface energy of N-S interface 

First, let us derive an auxiliary expression for the free energy which will be used below. Using 
dimensionless notations we get 



Then we integrate the item with V*P by parts, the surface integral being zero. In the rest integral 
we take into account that *P obeys the GL equation. As a result, 



H 



If one keeps the external field Ho fixed the corresponding thermodynamic potential can be ob- 
tained by subtracting HoB/47t. In a normal phase, correspondingly £l nH = Q.^ —Hq/Sh. As a 
result, 

|lj/|4~ 

(QsH — Q/ih) 



Q llir )dV=?p- I d'V 
An 



(H-HqY 



(12.5) 



Consider the problem where all the quantities depend only upon one co-ordinate, say x, while 
A _L x. The set of equations has the form (we'll see that ¥ is real) 



1 d 2x ¥ 

K 2 dx 2 



+ X ¥(l-A 2 )- X ¥ 3 



d 2 A 
dx 2 



0, 

0. 



d*¥ 

dx 



surface > 



It is easy to find the first integral of this set. Let us multiply the first equation by d^V /dx, the last 
one - by dA/dx and them add the equation and integrate over x: 



f 

Jo 



dx 



We obtain 



1 d 2v ¥(W 
K 2 dx 2 dx 



1 fdWY 



d*¥ 



dV, 



+ x i , — (\-A l )-—^ + 



dx 



dx 



d 2 AdA 
dx 2 dx 



-*¥ Z A 



dA 
dx 



0. 



A*) +,p2(1 - A2) -? + (s) 



const 



1 

2 
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(the constant being determined from the boundary conditions). 

To find the surface energy we formulate the boundary conditions 



oo (S): ¥=1, H=A = 0, d x ¥/dx = 0, 

-oo(N): Y = 0, H = H = 1/V2, d x ¥/dx = 0. 



x 

X 

At K 1 the most important region where A and H are small. Thus, we get 

2 



K 2 \dx) ^ 2 



1 

2 



d*¥ 

dx 



K 

7! 



(i-^ 2 ). 



The solution is 



¥ = tanh 



it is wrong in the region where the field penetrates, but this region is small. We observe that 
the typical length at which the order parameter is changed is (in dimensional units) ^ = k8. £, is 
called the coherence length. 

Now we can employ Eq. (112.51) and put Hq = 1 / \/2, H = 0. We obtain 



H. 



2 

c_ 

871 



1 - tanh 



KX 



dx 



In dimensional units that means 



V2\ 

4V2# C 2 8 
8tt k' 



H?4V2 
8tx^iT' 



The opposite limiting case can be treated only numerically. The result is that o ns = 0atK = 1/ v 2 
and at K > 1/ \/2 it is negative. This property has very important implication on the magnetic 
field structure in superconductors. 



Quantization of magnetic flux 

Consider a hollow cylinder placed into a longitudinal magnetic field. Assume that the cylinder is 




Figure 12.8: On the flux quantization in a hollow cylinder 



in the MeiBner state. If the order parameter has the form 
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the current is 



J = 



eh 



m 



2c / 
V%+-A 



We can divide the current density by I 1 !*! and integrate over a closed circuit in the bulk of super- 
conductor: 




eh 
m 



— v 

2nk 



flux 



Thus 



3> 



k<i> 0l <J>o = 7lHc/e = 2.07-l(T 7 G-cm 2 . 

It is interesting that the effect has been predicted by F. London (1950) before the concept of 
Cooper pairs. He assumed the quantum to be nhc/e = 2<&q. 
In any case the quantized quantity is in fact fluxoid 



which is equal to the total flux through the hole and the surface layer. As a result, the flux 
quantization through the hole is not exact. 

Quantization of magnetic flux through a hollow cylinder has been experimentally observed 
and has many implications. 



12.5 Mean field theory 
The mean field approximation 

This is a basic approximation which allows one to find main results regarding phase transitions 
leaving alone some subtle problems about correct critical exponents. For simplicity, let us restrict 
ourselves with the generic Ising model with the partition function 

z n = J^exp p£\/ (/ .v,.v ; + (3 J^hiSi ) . 

s \ i<j i J 

The main idea is to look at the world from a point of view of a given spin. A given spin i "feels" 
the external field + the fields created by the neighbors, 

hi({s}) = JlJij5j + hi, 

ij 

where prime means that i ^ j. The first step is to replace the actual field by the average one, 

/ / 

h i({s}) -+h e i= Y,Jij (s j) + hi = J^Jij m i + h i ■ 

ij ij 
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Then 

N 

Z N ^Z e = JV&*?« = f[2cosh(p/if ) . 

* !=1 

Then we have to close the scheme, i. e. to calculate m,- = (si). Since 

1 3lnZf, ,„ 
m / = -^/=tanh((3/ I f) 



we have the equation 



mi — tanh 



P Y, J ij m J + h i 



J 

which should be solved for m,-. 

In principle, it is a set of many equations, and further simplifications are required. Before 
doing that we shall list some comments. 

• The mean field approximation neglects the fluctuations of the order parameter. So the 
critical exponents are classical. 

• Contrary to the Landau theory, the mean field theory can be used even when the order 
parameter is not small. This is why it can be used to discuss global properties of the phase 
diagram. 

• The mean field theory works better if the interaction range is large. 



12.6 Spatially homogeneous ferromagnets 

Assume the spatial homogeneity, hi = h, and that surface effects are not important. Then 7, 7 
J(ri,Tj) = /(|r,- — Tj\). We obtain 



m = tanh[P(Jm + /z)] , / = 



i 

''7 ■ 



./ 



Let us discuss the case h = 0. The situation is illustrated in Fig. 1 12.91 where the l.h.s. and r.h.s. 
are plotted At small |3 (high temperatures) there is a unique solution m = 0, while at low T (large 
P) 3 solutions exist. Analysis of the free energy shows that the solution m = is unstable, the 
other ones are degenerate at h = 0. At the critical point all 3 solutions merge. That takes place at 

With nearest neighbor interaction and for a (hyper)cubic lattice / = 2 dJ where J is the nearest 
neighbor interaction. ^ 



4 At d = 1 the predictions of the mean field theory are wrong even qualitatively. 
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Figure 12.9: Graphical solution of the mean field 
equation. 



Let us re-derive the same expression form another point of view which seems useful for 
following discussions. From the mean field equation we we can calculate the susceptibility 

dm 
dh 



1 = 



= cosh _1 [|3 (Jm + h)} 



(3/ 



dh J T 



Putting h = and having in mind that at T > T c m = we obtain 

P T 
1 ~ 1-p/ ~ T-T c ' 

In this way we obtain that susceptibility id divergent at the critical point, and the critical exponent 
y=l. 



12.7 Renormalization framework 

The main idea (L. Kadanoff, 1966) is that since £ — > °° at the critical point there is no intrinsic 
scale for the long range fluctuations. Thus the fluctuations must have the similar appearance 
at all the scales. Geometrically speaking, the critical state should have properties of a fractal. 
Thus, critical Hamiltonian should exist for the variables on any scale. The Kadanoff 's idea was 
a starting point for K. Wilson who has developed a quantitative approach (Nobel Prize, 1983). 
The method is a mapping, or the renormalization group transformation which transforms the 
Hamiltonian from one scale into one describing the system on a larger length scale. 

The proper way to perform such a scaling is to keep long-range (critical) fluctuations un- 
changed. We shall briefly discuss only one way to perform such a scaling - the real space 
renormalization constructed by Th. Niemeijer and J.M.K. van Leeuven. 



The mapping 

Let us consider a general class of Ising models. The N spins take the values s ( - = ±1, the Hamil- 
tonian can be written as 

M{s) = Y,K iSi + Y, K ik s i s k + Y, K ikl s i s k s l + ■■■ = £^ K n a (5) • (12.6) 

( ik ikl a 
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Let us fix the origin on the energy scale by the stipulation 

J») = 0. 

s 

The equation (112.61) can be inverted to express the coupling constants K$ aP 

The thermodynamics of the model is contained in the partition function, 

Z N = Ye-W s \ g = -T lim UnZ N . 
~ ' jy 

Here Q is the free energy per spin. 

Our goal is to map the effective Hamiltonian (112.61) to another one relevant to a larger scale. 
Consider spins on a 2D triangular lattice, as shown in Fig. 112.101 Let us consider a triangle as a 




Figure 12.10: Cells in a triangular lattice. 



new spin. The "coarse-grained" spins are defined according to the algorithm that it is the same 
as the majority of spins in the covered triangle. This mapping can be analytically expressed as a 
projection operator, 



P{s\s) 



Tip p = ) 1 iM = sgn(4+4 + 4; 
11 " 1 10 otherwise 



Here i labels the cell while si are original spins in the cell i. Then we can write, 

Z N = ^P(s',s)e-^\ = 1. 

s' s s' 

Now we can determine a new Hamiltonian which is valid on the new scale as 

i 

5 To prove this equation one can substitute (112.6b into (112.7b . For every pair of sets a ^ P the spin st summed 
over all the states gives zero, Y*k s k — 0. When p = a each term gives unity, and there are 2 N such terms. 
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We have to introduce a spin-independent exponent to keep the property 

E#V) = o. 

s' 

This is a unique definition, and using the inversion scheme (112.71) we can determine a new set k' a 
of the coupling constants. So we know, at least in principle, the mapping K — > K'(K). 

The mapping 9f{s) — > M(s') is called the renormalization group transformation (RG). In this 
way we map a triangular lattice on another triangular lattice increasing the scale by y/3. So we 
can expect that singularities are the same for both Hamiltonians. 

Global properties of the mapping 

As a result of RG transform we get 

Z N = £P(s', S )e-^=e^Z' N ,. 

s 1 ,s 

Here ZL, is the partition function for the transformed Hamiltonian with N' cells. Since N' /N = 
l~ d where / is the scaling factor, 

^(K) = a 1 + i^(K / ), fli = fli/#. 

The spin-independent item is calculated from the initial configuration when the fluctuations are 
frozen. Thus it is not responsible for the singular behavior. Keeping only singular items we 
require 

£(K) = i£(K'). 

Before using the RG scheme let us recall that the physical correlation length remains the same. 
However while rescaling we use different yard sticks, so ^(K 7 ) = t^(K) . Since at the critical 
point ^(K c ) = oo it follows that the critical Hamiltonian is mapped also on the another critical 
Hamiltonian. 

To demonstrate the procedure, let us choose the 2D set of the coupling constants, K = 
(Ki,K2). An example is a magnetic system in a zero magnetic field having nearest and next- 
nearest neighbor interaction. To discuss dynamics let us recall that the quantities K e = — (3K 
rather than K enter the the theory. Thus changing the temperature we can move radially in the 
plane of effective coupling constants K e . The origin of the (Kf.K^) -plane corresponds to infinite 
temperature, while T = corresponds to the infinity in the direction given by the ratio K2/K1 
(dashed line in Fig. 112.1 II) . Since for every such direction there is a critical temperature, the 
subspace of the critical Hamiltonians is represented by a line of criticality in the (Kf , AT|)-plane. 

Suppose that we start from a supercritical Hamiltonian represented by point 1 . The repeated 
RG transforms generate Hamiltonians 2, 3, 4, • ■ ■ . The correlation length of the initial Hamil- 
tonian was finite, so in shrinks by / after each iteration. Thus the Hamiltonian moves more and 
more away from criticality. Eventually the point (Kf , Kfy = (0, 0) is reached. In other words, the 
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Figure 12.11: Results of RG transformation. The full line 
defines the critical subspace. Initial Hamiltonians in this 
subspace converge to the fixed point. An initial sub-critical 
Hamiltonian, 1, is, by subsequent transformations mapped 
on the Hamiltonians 2, 3, 4, etc., converging to the origin. 
An initial supercritical Hamiltonian, 1', is, mapped on the 
Hamiltonians 2', 3', 4', etc., moving off to infinity. The 
dashed line represents the locus of the laboratory system, 
with fixed physical coupling constants, as the temperature 
changed. 



origin is a fixed point for the RG transformation, with all the supercritical Hamiltonians belong 
to the basin of attraction associated with that fixed point. These considerations can be repeated 
for supercritical Hamiltonians which end at some of the fixed points at the infinity. 

The critical Hamiltonian stays at the critical line, so this line is an invariant space for RG 
transformation. Following K. Wilson, let us take for granted that under repeated mapping the 
critical Hamiltonian will converge to & fixed point Hamiltonian, However, one can imagine 
several fixed points with its own basin of attraction. This picture is usually represented as a 
RG flow diagram, Fig. 112.121 The consideration above can be generalized for the case of multi- 




Figure 12.12: RG flow lines. 



dimensional parameter space which we shall not do here. 

As we shall see, the critical exponents are determined by the properties of RG transformation 
near fixed points. That gives a new understanding of the concept universality class. 

Fixed point properties 

The definition of fixed point is 

K* = K'(K*). 
Near the fixed point one can linearize the mapping as 



5< = £r ap S#p, 5K = K-K*. 
P 
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Let us assume that eigenvalues of the matrix f are real and positive. Since f is asymmetric 
one must discriminate between left and right eigenvectors. The left eigenvector belonging to the 
eigenvalue X 1 is defined as 

One can introduce the scaling field as 

M; =3>''-SK. 

Then the rescaled field will be 

u'i = 3>' • 5K' = 3>' ■ • f • 5K = Xi& ■ 8K = X iUi . 

Then one can assume that n repeated RG transforms with rescaling factor / are equivalent to a 
single transform with a scaling factor 

iwi)} n =un- 

The solution of this equation has the form 

K(l) = l yi 

where y ; is the critical exponent. 

Usually 3 classes of the eigenvalues are discussed. 

• Irrelevant, with X, < 1, i. e. y, < 0. The corresponding scaling fields decay exponentially 
under RG transformations. 

• Relevant, with %i> 1, i. e. y ; > 0. They grow exponentially and remove the system from 
the critical point. 

• Marginal, with A,,- = 1, i. e. y ; - = 0. 

Connection to Physics 

Scaling fields are convenient variable to analyze the equation 

£(u) = i£(u'). 

For magnetic system there are only 2 relevant fields, u % — > x and Uh — > h. Thus we have 

g(x,h) = y d g(x',h') = y d g{PH,iy%. 

This is nothing else then the Widom's homogeneity postulate with replacement 

l d -> X, y x /d -> a, y^/J -> & . 
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Summary 

At present time, the RG theory is only an appealing picture, a seemingly fruitful way to think 
about critical phenomena. The precise conditions must be met to make the transform accept- 
able are less than clear. The main requirement is to leave long range fluctuations essentially 
untouched. 

According to K. Wilson, "There is no RG cookbook!". 



Chapter 13 

Transport phenomena 



13.1 Classical transport 

Boltzmann equation 

Let us consider electrons in a solid state as an example. We shall concentrate on the transport 
under influence of electric and magnetic field. 

According to classical physics, one can specify the coordinate r and the momentum p of the 
particle. Thus one can calculate the non-equilibrium distribution function, / p (r,?), the current 
density being 

j(r,t)=e J (dp)\f p (r,t). 

Here we denote (dp) = d d p/(2nh) d . The distribution function is defined by the Boltzmann 
equation 

df P (r,t) _ 
dt 



Here 

F = ^E+^[vxH] 

is the force acting upon the electrons, v = 3e p /3p is the (group) electron velocity, while 7 col] is 
the collision operator. It expresses the changes in the state due to quantum collisions and can 
be expressed through the the transition probability W ; y between the initial state (/) and the final 
state (/), 

Ufa) = £[WW/a(l -fa') ~ W a 'a/a'(l ~ fa)] ■ 
a' 

Here a denotes the electronic state (in our case a = {p,s}). 



dt 



dfdr 
dr dt 



dfdp 
3p dt 



df df ^f 

¥ +v ^ +F ap +/ - 



o 
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In a stationary situation and in the absence of external fields the solution of the Boltzmann 
equation is the Fermi function. Substituting it into the collision operator we obtain a very impor- 
tant relation between the probabilities of the direct and reverse processes, 

W aal e-^' kT = W a , a e-^ kT . 

Drude formula 

The simplest problem is to calculate the linear response to a small stationary electric field, E. 
Since we assume E to be small, it is reasonable to search solution as 

/p(r)=/ (e P )+/ (1) , |/ (1) |«/o- 
Since I mll (fo) = we come to the integral equation 

«/<») -^ga-~(-^). 

The linearized collision operator has the simplest form for elastic processes when W pv r = W p ' v . 
Then, 

w (1) )=E w w(^ 1) -4 1) )- 
p' 

Since we are interested in the function odd in p (to create a current) and it must be a scalar it is 
natural to assume that 

/^-(p-v), v = E/E. 

Under such an assumption 

The quantity x lr is called the transport relaxation time. If the material is isotropic then W is depen- 
dent only on the scattering angle between p and p'. From the simple geometrical construction 
shown in Fig. ll3.ll we observe that 

p' y = //cosG cos(|), p v =/?cos(|). 

Consequently, we can express the relaxation time in the form 

1 = £( £ )I /""de sine (l- cose) w(e). 

x„. 2 Jo 

Using the expression for the relaxation time we can write 
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e 

] / / p Figure 13.1: On the calculation of the transport relaxation time. 



As a result, we arrive at the Ohm's law, j = gE with 

Here ve means the projection of the velocity on the direction of the electric field, while (. . .) e 
means the average over the surface of a constant energy e, 

(A(p)) e = /(JP)A(P)5(£ " £P) 



/(rfp)8(e-6 p ) 
The quantity 

? 1 ? 1 

D = (v|x tr ) e = -v\ r = -vl 

has an explicit physical meaning. This is just the diffusion constant for the electrons with a given 
energy £. Indeed, for low temperatures we get 

o = e 2 g(e F )D(E F ). (13.2) 

On the other hand, the phenomenological expression for the current density in the presence of 
the density gradient reads as 

j = oE-eDVn, 

where D is th diffusion constant. In the equilibrium the current is zero and 

eDVn = eDg(z F )VC, = -aVcp. 



At the same time, the electro-chemical potential £ + <p/g, must be constant and Vcp = — eV^. 
Thus we identify the quantity with the diffusion constant. Eq. (113.21) is known as the Einstein 
relation. 
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13.2 Ballistic transport 
Landauer formula 

We start this chapter by a description of a very powerful method in physics of small systems - 
so-called Landauer approach. 

The main principle of this approach is the assumption that the system in question is coupled 
to large reservoirs where all inelastic processes take place. Consequently, the transport through 
the systems can be formulated as a quantum mechanical scattering problem. Thus one can reduce 
the non-equilibrium transport problem to a quantum mechanical one. 

Another important assumption is that the system is connected to reservoirs by ideal quan- 
tum wires which behave as waveguides for the electron waves. We start our analysis from the 
discussion of the properties of an ideal quantum wire. 

Ideal quantum wire 

Consider 2 large reservoirs of electron gas reservoirs having the difference 8n in the electron 
density and separated by a pure narrow channel. For small dn one can assume that there is a 
difference in a chemical potential, b/j = dn/g(£f). In the following we shall use the Fermi level 
of non-biased system as the origin for the chemical potentials. So the difference between the 
chemical potential in a-th reservoir will be denoted as /u a . 

If the channel is long and uniform, then the total current carried by the state characterized by 
a transverse mode n and a given direction of spin which propagates without scattering is 



If we take into account electron spin and N transverse modes are open, then the conductance is 
given by the expression G = ^-N. 

We come to a very important conclusion: an ideal quantum wire has finite resistance h/2e 2 N 
which is independent of the length of the wire. 

As we have seen, even an ideal quantum wire has a finite resistance. That means a finite heat 
generation even in the absence of any inelastic processes inside the wire. Below we will discuss 
the physical picture of heat release by a current-carrying nanostructure. 

First of all let us specify what heat release is. It will be convenient to consider an isolated 
system. Therefore we will have in mind the following physical situation. There is a capacitor 
which is discharged through the conductor of interest. The product RC of the whole system, 
R and C being the resistance and capacitance respectively, is much bigger than any relaxation 
time characterizing the electron or phonon system of the conductor. This means that for all the 
practical purposes the conduction process can be looked upon as a stationary one. The total 
energy of the system, U, is conserved, while its total entropy, S, is growing. The rate of heat 
generation is expressed through TdS/dt, where T is the temperature, i.e. through the applied 
voltage and characteristics of the nanostructure itself. This means that the result is independent 
of the assumption that the considered system is isolated, which is made only for the sake of 
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derivation. This themiodynamically defined heat is generated in the classical reservoirs over the 
length having a physical meaning of the electron mean free path. That is the same mean free path 
that enters the Drude formula, which determines the conductivity of the reservoirs themselves, 
the amount of heat generated per second in both reservoirs being the same. 

It is interesting to indicate that even purely elastic collisions can result in a heat generation 
although they of course cannot establish full equilibrium. This has a clear physical meaning. 
The amount of order in the electron distribution resulting in electric current can bring about 
mechanical work. For instance, one can let the current flow through a coil, and a magnetic rod 
can be drawn into the coil. In such a way the electrons transferring the current can execute a work 
on the rod. As a result of scattering, the amount of order in the electrons' distribution diminishes, 
and this means dissipation of mechanical energy into the heat. It has been shown that the heat 
release is symmetric in both reservoirs even if the scatterers in the system are asymmetric. 

All the above considerations do not mean that the collisions that give the main contribution 
to the heat release, also establish full equilibrium. What equilibrium needs is inelastic colli- 
sions which transfer the energy of electrons taking part in charge transfer to other degrees of 
freedom, such as to other electrons and phonons. In particular, a local equilibrium electron dis- 
tribution is established over the length scale determined by electron-electron interaction. Such a 
distribution can be characterized by a local electro-chemical potential and sometimes an electron 
temperature. The latter can in principle be measured by optical methods. On the other hand, the 
equilibrium with respect to the lattice is established at the scales of electron-phonon and phonon- 
phonon mean free paths. Only over those distances from the channel one can treat the results in 
terms of the true local temperature. 



Resistance of a quantum resistor 

Consider a system shown in Fig. 113.21 consisting of a barrier connected to reservoirs by ideal 
quantum wires. If there is some reflection only a part of the current is transmitted. In this 




Figure 13.2: On the resistance of a quantum resistor. 

case one can introduce the transmission probability of the mode n, T n , to obtain (including spin 
degeneracy) 

2 N 

n=l 

As a result, 

2e 2 N 2e 2 
G= — £r„ = — Trttt. (13.3) 
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Here t is the matrix of scattering amplitudes while the expression is called two-terminal Landauer 
formula. 

This very important and looking simple formula was confusing during a long period. Indeed, 
this is the conductance which is measured between two reservoirs. Having in mind that the 
resistance of the connecting ideal wires (per one conducting mode) is h/2e 2 we can ascribe to 
the scattering region the resistance 



h 

2? 



1 

--1 
T 



h R 

2e*T 



where R is the reflection coefficient. Consequently, in the original formulation the quantum 
resistance was described as 

2e 2 N T 

g 4iA' <13 - 4) 

However, the quantity which is usually measured is given by Eq. (113.31) . 

Now we derive the Landauer formula for finite-temperature and so-called multichannel case 
when the leads have several transverse modes. Consider ideal wires which lead to a general 
elastic scattering system. Let each lead has the cross section A and have N± transverse channels 
characterized by wave vectors /c,- so that, 

h 2 kf 

E l + —^=E F . 
2m 

The incoming channels are fed from the electron baths with the same temperature and chemical 

potentials jUi,^ The outgoing channels are fed up to thermal equilibrium population. We 

shall assume that the particles are absorbed in the outgoing baths. The sources are assumed to be 
incoherent, the differences /ji — /J2 are also assume small to yield linear transport. We introduce 
the scattering amplitudes tjj for the transmission from 7'th incoming to z'th outgoing channel. 
Reflection amplitudes ru are introduces in a similar way for reflection into the z'th incoming 
channel. If we replace the incoming and outgoing channels, we denote the proper amplitudes by 
primes. In this way it is convenient to introduce 2N± x 2N± scattering matrix as 



5 



r t' 
t r> 



From the current conservation we must require unitarity while from time reversal symmetry 
5 = 5. Thus we have also 55* = / where star stays for complex conjugation while tilde for 
transposition. In a magnetic field the Onsager relation requires S(H) = S(—H). 
It one defines the total transmission and reflection into z'th channel as 



j j 

then from unitarity condition we get 

£j; = E(i-k,). 



nil 2 - 
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Since the densities of states in each channel are ID like, gi(E) = (jlhvi) 1 we write the current 
through outgoing channels as 

1 = ^HjdE[ME)Ti(E)+f 2 (E)R\E)-f 2 (E)] 
Thus the conductance becomes 

This is the two-terminal conductance measured between the outside reservoirs which includes 
contact resistances. 



Point ballistic contact 

The most clean system is the so-called quantum point contact (QPC) - short and narrow con- 
strictions in 2d electron gas. A sketch of QPC is shown in Fig. U3.3l The conductance of QPC 





Figure 13.3: A sketch of a QPC 
formed by split gates. 



is quantized in the units of 2e 2 /h. The quantization is not that accurate as in quantum Hall ef- 
fect (about 1%) because of non-unit transparencies T n and finite temperature. It is interesting to 
compare quantum and classical behavior of QPC. In a classical picture one can write 

/•Jt/2 j a i 

J = W(bn)vF — cosa = -WvFi§n) . 
J-n/2 2% 7t 



Thus the "diffusion constant" is 

J 1 



D 



eff 



8/7 



G = e 2 g(£ F )D eff 



2e 2 k F W 
h % 



Note that the integer part of the quantity kp W /% is just the number of occupied modes according 
to quantum mechanics. 
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+ eV 



I 




W % 

T 



Figure 13.5: On the classical conductance of a 
point contact. 



Appendix A 
Notations 



Microscopic variables 

q — > (q\, q2, . . . ,<?/) - generalized coordinates, 
p — > {p\,pi,---,Pf) - conjugated momenta, 
^(^, p) - classical Hamiltonian, 

M - quantum Hamiltonian, 

f 

dT = ]lj = i dqjdpj - element of phase space, 
m - mass of a molecule, 

T(£', . . .) - number of states with the energy < E , 

D(E, ...)= dT/dE = Tr8 (e - k^j = yJdTd \E-9i (p,q)} - state density, 
S - spin, 

c - velocity of light, 

gi - degeneracy of ?'-th state. 



Macroscopic variables 

V - volume of the box which contains the system, 
P - pressure, 

T - absolute temperature (we use also energy units), 

P = 1/T - inverse temperature, 

E - total energy, 

U - internal energy, S - entropy, 

S t - total entropy for the body and surrounding medium, 

F - (Helmholtz) free energy, 

H - thermal function, enthalpy, 

G - Gibbs free energy, thermodynamic potential, 

£2 - Landau free energy. 
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Electric and Magnetic Variables 

B - magnetic field, 

e - electronic charge, 

H = e/2mc - Bohr magneton. 

Constants 

k = 1.38 x 10~ 16 erg/K - Boltzmann constant, 
h - Planck constant, h = h/2n , 



Useful mathematical formulas 

The Stirling's formula: 

logn! PS n Xogn — n+ 1 at n>l. 

or more accurate 

/I ! « ^2tu (n+i)n"e _n . 

Thermodynamic relations 

Thermodynamic potentials 



Thermodynamic potential 


Notation 


Independent variables 


Differential 


Internal energy 


U 


S, V,N 


TdS-PdV+iudN 


Heat function (enthalpy) 


H 


S,P,N 


TdS + VdP + vdN 


Helmholtz free energy 


F 


T, V 7 N 


-SdT-PdV+vdN 


Gibbs free energy 


G 


T,P,N 


-SdT + VdP+ijdN 


Landau free energy 


ft 


T,V,p 


-SdT-PdV-Nd/j 



Table A.l: Thermodynamic potentials (summary) 



Basic distributions 

The Gibbs distribution 



w„=L-0*», Z = J>"P*. 

Z s 



The Maxwell-Boltzmann distribution 



f q (q) = 

The Fermi-Dirac distribution 
The Bose-Einstein distribution 



Jdq* 



-Mq) 



-i -l 



-pv(«) 



ft 



fk 



e m-f) + 1 



The chemical potential /j is determined by the normalization 

gk 



gPfo-ju) _|_ j 



iV. 
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= f P {p)-fq{q)\ 

f p (p) = (2^m)- 3 / 2 e-^ + Py + ^/ 2m , $=1/T; 



Relations between thermodynamic and statistical quantities 



z 

F 



-p£„. 



-riogZ; 

N V 



a = 7"io g £( A V £V 
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Appendix B 

On the calculation of derivatives from the 
equation of state 



Important relations arise from the properties of partial differentiations. Consider 3 quantities, 
X,Y,Z, related by the equation of state 9<i(X,Y,Z) = const. Now let us considerX,y as indepen- 
dent variables, while Z = Z(X, Y). We have 



(§)/- 



dYj 



\ dY-dZ = 0. 

x 



(B.l) 



If y,Z are taken as independent variables, then 

(dx 

[dY 



-dX + -. 



dY + 



fdX 



dZ = 



(B.2) 



Now we multiply Eq. IB.ll by j and Eq. IB.2l by ^gf ^ an d subtract the results. We obtain 



dZ 

dx 



dx 

dY 



+ 



dz\ 
by) 



x. 



dX + 



dX 
dY 



dX 
dZ 



dz 

dY 



x. 



dZ = 0. 



Since dX and dY are independent, this equation is compatible if 



fdZ\ fdX\ fdZ 
{dx) y {dY) z + {dY 

(dx\ fdx\ (dz 

\d~Yj z + {dz) Y {dY 



X 



X 




0. 



or 



(dx 

[dY 



3F 
dZ 



x 



dx 

dY 



dZ 
dX 

dY\ 

dx) : 



-1 



(B.3) 
(B.4) 
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General scheme for transformation: Consider any quantity (X, Y), the differential of which 
can be expressed as 

Then we divide it by dZ and assume Y = const, (dY = 0). We get 



BZJy \dXjy\dZjy' 

Another important relation arises if one divides the expression for df by xX, 



(B.5) 



%)A%)A%)Mz- (B - 6) 

Equations (|B.5I) . (IB .61) together with Eqs. (|B.3I) . (IB .41) and the Maxwell relations are usually 
used for transformations and computation of derivatives from the equation of state. 
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